-- Logs begin at Fri 2022-06-03 15:30:30 UTC, end at Fri 2022-06-03 16:40:32 UTC. -- Jun 03 16:06:54.950743 dv-cinder-836996-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 16:06:54.959541 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 16:06:54 2022] *** Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: nodename: dv-cinder-836996-28-iscsi Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: machine: x86_64 Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: clock source: unix Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: pcre jit disabled Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: detected number of CPU cores: 4 Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: current working directory: / Jun 03 16:06:54.962146 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: detected binary path: /usr/bin/uwsgi-core Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: your processes number limit is 47680 Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: your memory page size is 4096 bytes Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: detected max file descriptor number: 2048 Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: lock engine: pthread robust mutexes Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: thunder lock: enabled Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 16:06:54.962826 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 16:06:55.005338 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: Python main interpreter initialized at 0x55986fdc69c0 Jun 03 16:06:55.005338 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: python threads support enabled Jun 03 16:06:55.005338 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: your server socket listen backlog is limited to 100 connections Jun 03 16:06:55.005338 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: your mercy for graceful operations on workers is 90 seconds Jun 03 16:06:55.005655 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 16:06:55.005729 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: *** Operational MODE: preforking *** Jun 03 16:06:55.006006 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: *** uWSGI is running in multiple interpreter mode *** Jun 03 16:06:55.006006 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: spawned uWSGI master process (pid: 103197) Jun 03 16:06:55.006182 dv-cinder-836996-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 16:06:55.007531 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: spawned uWSGI worker 1 (pid: 103198, cores: 1) Jun 03 16:06:55.007531 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: spawned uWSGI worker 2 (pid: 103199, cores: 1) Jun 03 16:06:55.007531 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 16:06:56.226529 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 16:06:56.227854 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 16:06:56.935772 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:06:56.935772 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: from cryptography.utils import int_from_bytes Jun 03 16:06:56.936107 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:06:56.936107 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: from cryptography.utils import int_from_bytes Jun 03 16:06:56.941763 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:06:56.941763 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: from cryptography.utils import int_from_bytes Jun 03 16:06:56.942106 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:06:56.942106 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: from cryptography.utils import int_from_bytes Jun 03 16:06:59.513346 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 16:06:59.513865 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 16:06:59.514023 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 16:06:59.514384 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 16:06:59.514637 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 16:06:59.515019 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.515359 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.515680 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.515998 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.516331 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.516638 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.516957 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.517273 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.517598 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.517856 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.518169 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.518369 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 16:06:59.518756 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-28-iscsi {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.518841 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 16:06:59.518919 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.519091 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.519189 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 16:06:59.519426 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.519533 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 16:06:59.519748 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.519835 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 16:06:59.520050 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.520143 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.520372 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.520460 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.520675 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.520760 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.521062 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.521166 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.521399 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.522554 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.522653 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.522722 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.522788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.522864 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.522940 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.523007 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.523072 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.523137 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.523213 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.523432 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.524123 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.524271 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.524404 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-28-iscsi {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.524568 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.524708 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.524880 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525020 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525179 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525335 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525571 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-28-iscsi {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525678 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525885 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.525990 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.526193 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.526311 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.526506 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.526620 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.526909 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527040 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527264 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527382 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527557 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527677 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527866 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.527978 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.528239 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.528344 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.528530 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.528653 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.528795 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.528910 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529150 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529270 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529392 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529512 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529743 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529836 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.529999 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.530137 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.530305 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.530517 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-28-iscsi {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.530618 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.530869 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.530964 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.531151 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.531243 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.531494 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.531597 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.531755 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.531920 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.532081 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.532229 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.532380 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.532544 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.532692 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.532872 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533034 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533200 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533298 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533478 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533569 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533796 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.533895 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.534113 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.534221 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.534417 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.534516 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.534721 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.534820 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535024 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535092 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535335 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535489 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535651 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535800 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.535944 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.536133 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.536224 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.536467 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.536559 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.536778 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.536876 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.537097 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.537192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.537382 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.537483 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.537703 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.537801 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538019 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538118 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538373 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538474 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538647 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538745 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.538918 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.539027 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.539272 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.539402 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.539621 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.539711 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.539930 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540034 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540247 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540348 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540561 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540652 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540864 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.540964 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.541165 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.541329 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.541470 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.541607 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.541751 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.541888 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542071 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542224 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542389 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542528 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542673 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542810 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.542946 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.543128 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.543271 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.543470 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.543625 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.543770 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.543907 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544072 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544240 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544386 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544534 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544672 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544807 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.544942 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.545077 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.545222 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.545392 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.545537 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.545731 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.545877 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546076 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546383 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546518 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546663 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546800 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.546935 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.547079 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.547343 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.547493 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.547630 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.547856 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548000 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548146 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548303 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548440 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548584 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548723 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.548869 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549023 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549161 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549297 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549484 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549628 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549833 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.549988 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.550167 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.550331 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.550468 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.550613 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.550765 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.550916 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.551054 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.551191 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.551371 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.551515 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.551751 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.551904 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.552089 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.552243 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.552431 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.552576 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.552768 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.552916 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.553059 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.553195 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.553365 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.553522 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.553741 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.553881 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554018 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554161 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554316 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554453 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554599 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554736 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.554880 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555019 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555163 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555348 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555494 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555632 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555791 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.555930 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.556067 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.556253 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.556413 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.556587 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.556741 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.556878 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.557020 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.557167 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.557339 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.557558 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.557702 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.557852 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.557990 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.558139 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.558297 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.558436 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.558573 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.558710 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.558859 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.559012 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.559199 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.559394 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.559538 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.559674 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.559847 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.559993 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.560192 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.560338 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.560515 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.560659 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.560848 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.560993 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.561153 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.561305 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.561443 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.561579 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.561758 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.561910 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.562060 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.562208 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.562382 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.562534 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.562687 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.562826 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.562977 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.563125 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.563322 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.563484 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.563629 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.563773 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.563910 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.564055 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.564224 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.564379 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.564518 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.564653 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.564833 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.564989 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:06:59.565167 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.565319 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.565503 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.565647 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.565822 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.565992 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.566148 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.566305 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.566450 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.566589 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.566727 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.566915 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.567060 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.567243 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.567439 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.567663 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.567806 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.567944 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568080 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568240 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568386 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568524 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568662 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568805 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.568952 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.569090 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.569226 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.569396 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.569540 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.569711 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.569866 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.570004 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.570200 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.570353 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.571049 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.571194 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.571383 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.571538 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.571704 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.571850 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572021 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572174 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572347 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572500 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572661 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572817 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.572956 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.573093 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.573261 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.573418 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.573555 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.573693 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.573851 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574005 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574154 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574298 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574436 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574583 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574744 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.574902 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.575065 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.575218 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.575420 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.575574 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.575720 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.575937 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576078 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576222 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576363 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576508 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576663 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576815 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.576953 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.577091 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.577235 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.577372 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.577517 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.577680 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.577892 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578035 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578181 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578327 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578473 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578760 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.578897 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579033 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579202 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579397 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579542 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579679 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579840 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.579984 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.580152 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.580312 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.580450 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.580598 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.580743 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.580880 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581055 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581203 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581348 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581483 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581660 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581818 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.581970 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.582108 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.582268 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.582422 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.582582 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.582724 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.582905 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583051 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583188 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583366 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583528 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583667 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583845 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.583991 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.584159 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.584463 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.584770 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.585072 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.585372 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.585675 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.585992 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.586896 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.587240 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.587496 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.587701 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.587847 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.588123 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.588280 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.588526 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.588695 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.588880 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.589027 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.589298 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.589443 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.589649 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.589805 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.589997 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.590244 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.590403 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.590637 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.590985 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.591360 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.591523 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.591700 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.591847 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.592069 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.592305 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.592452 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.592780 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.592937 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.593147 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.593290 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.593493 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.593640 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.593842 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.594088 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.594406 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.594767 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.594922 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.595171 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.595347 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.595551 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.595696 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.595898 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.596087 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.596315 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.596532 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.596689 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.596977 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.597136 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.597385 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.597529 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.597798 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.598123 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.598430 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.598586 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.598725 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.598869 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.599036 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.599182 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.599448 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.599605 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.599780 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.599933 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.600078 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.600224 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.600409 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.600706 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.600844 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601018 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601164 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601310 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601459 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601637 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601787 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.601950 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602104 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602253 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602391 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602562 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602715 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602853 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.602990 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.603172 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.603366 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.603523 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.603661 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.603797 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.603933 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.604101 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.604248 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.604418 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.604570 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.604709 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.604855 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.605015 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.605210 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.605367 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.605575 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.605720 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.605926 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606080 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606218 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606354 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606683 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606850 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.606996 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.607160 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.607356 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.607513 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.607651 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.607800 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.607950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.608088 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.608319 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.608473 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.608620 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.608758 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.608895 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.609032 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.609215 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.609368 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.609598 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.609745 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.609882 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610026 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610164 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610308 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610454 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610611 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610749 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.610885 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.611022 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.611181 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.611366 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.611574 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.611719 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.611920 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612064 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612238 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612384 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612542 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612689 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612846 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.612998 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.613167 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.613313 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.613471 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.613636 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.613775 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.613912 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614056 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614211 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614351 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614674 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614820 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.614966 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.615105 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.615270 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.615466 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.615604 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.615741 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.615891 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.616060 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.616204 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.616415 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.616597 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.616743 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.616890 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617028 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617164 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617336 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617488 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617656 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617803 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.617989 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.618133 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.618368 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.618523 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.618674 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.618812 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.618950 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619087 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619223 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619404 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619565 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619710 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619848 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.619992 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620131 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620276 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620414 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620557 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620694 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620841 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.620977 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.621123 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.621259 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.621409 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.621642 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.621794 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.621955 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.622109 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.622276 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.622428 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.622591 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.622744 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.622882 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.623031 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.623194 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.623385 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.623528 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.623665 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.623853 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624006 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624169 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624315 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624499 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624653 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624826 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.624984 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625123 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625261 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625408 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625555 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625700 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625847 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.625992 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.626136 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.626280 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.626426 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.626564 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.626710 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.626847 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.627024 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.627169 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.627429 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.627590 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.627739 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.627883 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.628020 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.628157 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.628325 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.628566 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.628711 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.628921 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629074 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629211 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629356 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629516 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629663 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629814 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.629953 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.630089 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.630225 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.630380 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.630521 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.630679 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.630825 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631018 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631170 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631392 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631540 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631686 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631825 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.631970 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.632116 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.632293 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.632438 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.632597 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.632742 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.633401 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.633557 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.633736 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.633894 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634031 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634177 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634314 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634463 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634601 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634740 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.634906 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.635051 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.635211 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.635534 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.635681 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.635842 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.635997 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.636134 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.636356 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.636503 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.636641 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.636786 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.636924 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.637061 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.637207 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.637345 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.637536 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.637681 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.637871 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638018 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638169 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638315 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638461 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638701 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638847 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.638986 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.639123 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.639273 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.639469 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.639609 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.639746 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.639894 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640033 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640185 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640323 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640460 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640597 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640733 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.640878 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641025 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641169 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641381 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641532 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641670 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641826 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.641964 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.642176 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.642323 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.642510 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.642655 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.642847 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.642992 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.643131 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.643268 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.643438 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.643578 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.643728 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.643893 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.644031 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.644236 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.644389 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.644590 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.644752 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.644896 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645039 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645184 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645336 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645489 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645634 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.645940 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.646092 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.646286 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.646448 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.646882 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647035 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647180 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647356 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647507 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647664 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647809 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.647993 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.648167 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.648323 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.648502 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.649256 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.649418 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.649563 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.649707 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.649850 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650005 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650156 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650301 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650446 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650589 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650743 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.650900 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.651046 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.651223 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.651404 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.651584 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.651742 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.651940 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.652095 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.652246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.652390 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.652560 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.652711 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.652874 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653026 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653170 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653314 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653458 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653615 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653760 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.653952 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.654106 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.654318 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.654478 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.654637 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.654781 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.654935 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655079 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655222 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655393 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655557 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655703 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655846 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.655990 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.656133 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.656307 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.656473 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.656651 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.656816 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.656987 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.657152 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.657307 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.657450 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.657593 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.657736 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.657881 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658036 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658193 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658338 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658489 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658640 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658797 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.658941 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.659093 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.659319 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.659478 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.659623 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.659765 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.659909 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660069 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660213 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660357 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660509 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660653 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660822 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.660969 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.661113 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.661282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.661435 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.661633 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.661795 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.661947 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.662096 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.662239 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.662382 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.662540 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.662699 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.662855 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.663006 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.663151 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.663329 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.663495 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.663713 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.663867 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.664012 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.664184 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.664331 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.664488 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.664664 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.664830 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665005 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665166 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665310 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665466 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665611 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665755 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.665932 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.666080 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.666224 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.666377 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.666622 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.666776 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.666930 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.667075 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.667219 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.667460 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.667626 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.667828 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.667981 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.668138 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.668297 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.668443 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.668601 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.668746 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.668948 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.669112 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.669295 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.669448 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.669593 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.669744 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.669890 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.670035 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.670188 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.670347 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.670492 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.670732 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.670897 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.671177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.671407 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.671561 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.671705 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.671902 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672055 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672207 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672351 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672508 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672661 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672813 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.672957 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.673110 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.673254 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.673420 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.673567 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.673710 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.673852 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674010 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674163 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674309 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674459 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674606 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674757 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.674911 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675056 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675210 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675381 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675529 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675691 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675837 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.675981 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.676131 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.676284 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.676428 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.676584 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.676732 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.676876 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677020 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677181 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677370 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677533 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677680 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677824 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.677967 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.678110 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.678283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.678449 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.678594 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.678746 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.678892 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.679042 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.679207 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.679416 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.679565 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.679709 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.679883 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680028 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680185 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680336 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680488 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680632 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680782 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.680928 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681092 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681237 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681381 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681524 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681666 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681809 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.681962 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.682107 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.682197 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.682424 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.682511 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.682721 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.682828 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683036 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683132 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683363 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683453 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683665 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683752 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.683983 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.684083 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.684282 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.684371 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.684594 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.684679 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.684895 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.685018 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.685193 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.685348 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.685490 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.685689 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.685790 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.686031 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.686120 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.686384 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.686471 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.686698 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.686795 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687015 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687102 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687361 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687451 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687672 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687770 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.687995 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.688122 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.688309 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.688445 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.688618 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.688753 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.688930 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689059 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689248 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689377 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689550 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689679 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689848 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.689976 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.690183 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.690321 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.690455 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.690670 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.690799 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.690985 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.691114 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.691316 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.691460 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.691625 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.691751 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.691923 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692052 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692221 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692350 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692537 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692673 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692838 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.692966 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.693154 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.693283 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.693458 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.693586 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.693758 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.693886 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694058 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694188 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694357 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694486 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694693 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694830 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.694992 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.695122 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696029 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696164 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696417 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696542 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696665 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696787 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.696999 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.697128 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.697331 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.697461 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.697648 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.697783 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.697982 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.698108 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.698292 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.698418 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.698604 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.698740 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.698912 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699053 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699221 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699383 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699555 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699697 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699857 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.699998 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.700167 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.700295 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.700478 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.700605 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.700791 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.700927 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.701106 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.701304 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.701432 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.701629 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.701764 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.701939 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702068 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702247 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702374 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702558 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702694 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702868 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.702996 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.703324 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.703517 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.703696 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.703831 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.703956 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.704116 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.704244 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.704421 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.704559 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.704745 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.704873 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.705064 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.705193 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.705383 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.705523 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.705693 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.705829 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706013 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706148 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706327 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706455 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706638 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706766 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.706950 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.707079 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.707286 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.707459 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.707622 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.707750 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.707926 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708065 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708237 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708373 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708549 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708685 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708861 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.708999 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.709171 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.709299 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.709479 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.709606 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.709787 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.709929 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.710097 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.710237 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.710402 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.710528 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.710707 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.710908 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.711085 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.711721 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.711890 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712016 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712197 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712333 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712506 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712634 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712815 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.712944 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.713126 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.713252 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.713435 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.713562 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.713748 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.713874 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.714057 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.714259 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.714389 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.714570 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.714697 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.714896 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.715026 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.715216 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.715375 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.715560 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.715689 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.715875 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716002 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716186 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716314 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716503 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716685 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716819 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.716953 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.717078 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.717201 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.717384 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.717512 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.717689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.717860 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.718057 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.718354 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.718483 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.718688 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.718911 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.719040 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.719313 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.719763 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.719923 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.720247 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.720374 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.720562 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.720875 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.721005 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.721274 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.721597 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.721822 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.722126 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.722460 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.722598 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.722781 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.723044 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.723181 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.723435 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.723704 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.723835 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.724063 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.724302 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.724437 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.724901 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.725475 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.725609 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.725829 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.726089 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.726204 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.726502 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.726683 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.726866 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.727271 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.727416 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.727729 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.727898 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.728062 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.728392 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.728541 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.728714 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.729030 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.729160 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.729394 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.729610 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.729747 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.730025 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.730195 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.730330 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.730657 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.730793 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.730980 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.731347 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.731471 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.731793 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.731937 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.732119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.732442 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.732570 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.732763 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.733081 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.733219 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.733401 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.733664 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.733796 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.734038 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.734230 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.734373 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.734691 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.734819 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.735012 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.735352 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.735497 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.735677 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.735942 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.736213 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.736354 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.736540 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.736804 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.736940 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.737186 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.737315 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.737513 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.737642 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.737832 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.737961 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.738151 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.738279 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.738465 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.738604 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.738779 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.738906 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.739087 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.739214 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.739424 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.739579 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.739740 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.739869 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740051 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740180 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740377 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740515 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740682 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740816 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.740991 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.741124 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.741302 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.741439 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.741616 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.741744 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.741929 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.742155 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.742808 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.743040 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.743170 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.743390 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.743521 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.743726 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.743960 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.744090 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.744298 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.744436 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.744621 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.744759 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.744958 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.745087 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.745286 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.745414 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.745595 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.745736 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.745902 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746032 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746209 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746338 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746519 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746648 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746831 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.746962 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.747139 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.747273 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.747474 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.747616 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.747784 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.747911 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.748091 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.748224 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.748400 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.748537 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.748707 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.748836 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749015 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749145 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749321 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749464 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749628 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749765 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.749935 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750064 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750240 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750370 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750545 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750680 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750855 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.750990 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.751166 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.751325 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.751507 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.751648 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.751818 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.751955 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.752129 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.752257 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.752436 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.752561 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.752743 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.752868 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.753051 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.753179 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.753358 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.753485 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.753666 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.753871 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754006 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754131 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754296 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754426 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754607 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754745 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.754912 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.755041 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.755223 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.755369 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.755576 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.755718 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.755896 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.756025 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.756213 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.756352 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.756562 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.756698 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.756881 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.757015 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.757199 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.757416 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.757573 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.757756 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.757927 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.758644 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.758773 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.758988 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.759135 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.759431 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.759568 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.759704 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.759837 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.759961 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.760098 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.760276 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.760405 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.760591 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.760718 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.760894 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761031 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761202 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761339 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761515 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761655 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761820 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.761949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.762121 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.762251 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.762421 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.762549 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.762728 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.762858 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763028 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763164 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763398 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763545 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763672 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763797 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.763950 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764079 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764257 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764394 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764557 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764686 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764860 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.764988 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.765163 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.765300 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.765463 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.765592 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.765766 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.765895 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766052 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766186 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766360 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766489 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766660 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766790 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.766962 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.767099 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.767262 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.767437 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.767586 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.767715 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.767889 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768019 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768218 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768345 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768547 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768675 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768860 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.768992 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.769181 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.769377 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.769513 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.769698 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.769827 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770023 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770152 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770348 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770476 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770664 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770793 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.770995 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.771123 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.771314 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.771454 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.771920 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772052 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772229 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772365 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772540 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772675 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772850 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.772979 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.773158 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.773285 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.773478 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.773620 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.773791 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.773919 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.774116 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.774245 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.774437 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.774573 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.774741 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.774869 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.775064 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.775191 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.775404 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.775547 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.775723 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.775850 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776035 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776162 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776342 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776471 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776654 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776780 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.776963 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.777099 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.777270 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.777397 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.777584 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.777711 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.777892 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778020 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778202 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778338 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778515 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778643 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778827 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.778962 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.779147 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.779269 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.779461 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.779586 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.779763 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.779901 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.780074 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.780202 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.780386 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.780519 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.780694 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.780830 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781004 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781133 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781334 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781462 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781645 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781784 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.781954 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.782083 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.782267 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.782394 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.782568 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.782698 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.782822 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 16:06:59.782947 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.783231 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.783571 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.783921 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.784275 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.784626 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.784954 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.785277 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.785588 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.785925 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.786243 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.786561 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.786878 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.787192 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.787529 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.787845 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.788177 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.788513 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.788826 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.789181 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.789503 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.789829 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.790149 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.790465 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.790817 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.791134 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.791477 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.791802 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.792120 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.793537 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.793537 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.793537 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.793936 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.794061 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.794379 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.794711 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.795044 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.795418 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.795739 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.796088 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.796422 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.796744 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.797061 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.797374 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:06:59.797622 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 16:06:59.841411 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Registered counter for database nova_api Jun 03 16:06:59.861962 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Registered counter for database nova_api Jun 03 16:06:59.863042 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:06:59.870956 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:06:59.886760 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:06:59.894036 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:06:59.927794 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.context [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3aa4319c-5fbd-4b59-928b-816489450cee(cell1) {{(pid=103199) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 16:06:59.932492 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:06:59.934062 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:06:59.934860 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:06:59.936836 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_concurrency.lockutils [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:06:59.938840 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Registered counter for database nova_cell0 Jun 03 16:06:59.942905 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Registered counter for database nova_cell1 Jun 03 16:06:59.949838 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.context [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3aa4319c-5fbd-4b59-928b-816489450cee(cell1) {{(pid=103198) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 16:06:59.951277 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:06:59.952979 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:06:59.954070 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:06:59.955676 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:06:59.956466 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:06:59.958412 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:06:59.958546 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:06:59.960411 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Registered counter for database nova_cell0 Jun 03 16:06:59.961096 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:06:59.964379 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Registered counter for database nova_cell1 Jun 03 16:06:59.971496 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:06:59.974967 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:06:59.977363 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:07:00.109564 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO dbcounter [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Registered counter for database nova_cell0 Jun 03 16:07:00.118616 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:07:00.119086 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG oslo_db.sqlalchemy.engines [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:07:00.123401 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writer thread running {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:07:00.127653 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Registered counter for database nova_cell0 Jun 03 16:07:00.136280 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:07:00.140498 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:07:00.577009 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:07:00.583664 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:07:00.584446 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:07:00.591419 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:07:00.804510 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:07:00.809820 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:07:00.810439 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:07:00.815520 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55986fdc69c0 pid: 103198 (default app) Jun 03 16:07:00.815701 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: WARNING keystonemiddleware.auth_token [None req-02dbbb15-46b5-44d3-a655-db68674c8c74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:07:00.817749 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:07:00.818920 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001692 Jun 03 16:07:00.819334 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Fri Jun 3 16:07:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:07:00.820780 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55986fdc69c0 pid: 103199 (default app) Jun 03 16:08:19.166813 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:19.167849 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 03 16:08:19.168236 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:19.180662 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=3 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:19.181541 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell0:SELECT=3 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:19.182270 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell1:SELECT=3 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:19.183152 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:19.670174 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-c1eff33f-3249-4557-8190-ff03f34a6ff9 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:19.701993 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-c1eff33f-3249-4557-8190-ff03f34a6ff9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.526478 Jun 03 16:08:19.702907 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Fri Jun 3 16:08:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:22.002598 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:22.003652 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a0e7ef57-f35d-4d2e-a741-097fd6e7611d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 03 16:08:22.004317 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:22.068649 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1393aebd-2639-41fd-964a-7046f451bbcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:22.086282 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:08:22.086282 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 03 16:08:22.118519 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1393aebd-2639-41fd-964a-7046f451bbcc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108456 Jun 03 16:08:22.119782 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:22.133448 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:22.134857 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:22.135735 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell1:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:22.136827 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:08:22.344270 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-49439fba-044c-4321-a8a1-7624247626e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:22.346770 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:08:22.346770 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 03 16:08:22.413254 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-49439fba-044c-4321-a8a1-7624247626e0 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285187 Jun 03 16:08:22.427325 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Fri Jun 3 16:08:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:24.739711 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1393aebd-2639-41fd-964a-7046f451bbcc admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:24.740829 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1393aebd-2639-41fd-964a-7046f451bbcc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 03 16:08:24.741295 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:24.847756 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-80c73dcf-cc04-45f7-9e15-c3dcc509e465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:24.864846 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:08:24.864846 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 03 16:08:24.884646 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-80c73dcf-cc04-45f7-9e15-c3dcc509e465 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137487 Jun 03 16:08:24.885322 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:24.897523 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-b1907af0-79f6-4b88-92c0-83a39f5ed9cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:24.899167 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:08:24.899167 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: warnings.warn(msg) Jun 03 16:08:24.934541 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-b1907af0-79f6-4b88-92c0-83a39f5ed9cb admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040998 Jun 03 16:08:24.935681 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Fri Jun 3 16:08:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:27.264124 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-80c73dcf-cc04-45f7-9e15-c3dcc509e465 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:27.265142 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-80c73dcf-cc04-45f7-9e15-c3dcc509e465 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 03 16:08:27.265797 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:27.330159 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-ca11f2b3-d33b-4008-84c1-65d9d77d40f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:27.349963 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-ca11f2b3-d33b-4008-84c1-65d9d77d40f5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076611 Jun 03 16:08:27.357581 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:27.362646 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-f2cdeecb-b572-4604-a11b-af1d38e43049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:27.388466 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-f2cdeecb-b572-4604-a11b-af1d38e43049 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029406 Jun 03 16:08:27.389131 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Fri Jun 3 16:08:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:29.692812 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-ca11f2b3-d33b-4008-84c1-65d9d77d40f5 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:29.694055 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-ca11f2b3-d33b-4008-84c1-65d9d77d40f5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jun 03 16:08:29.694532 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:29.758484 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-c33c3740-9b95-4508-b395-b300c484369d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:29.778373 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-c33c3740-9b95-4508-b395-b300c484369d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077478 Jun 03 16:08:29.778951 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:29.792074 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-038a94db-a031-474c-a5ff-2248c9a5eda9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:29.816414 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-038a94db-a031-474c-a5ff-2248c9a5eda9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028055 Jun 03 16:08:29.817256 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Fri Jun 3 16:08:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:32.114300 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-c33c3740-9b95-4508-b395-b300c484369d admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:32.115393 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-c33c3740-9b95-4508-b395-b300c484369d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 03 16:08:32.116009 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:32.177440 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-483074ca-7eda-425a-a9c7-abc540288b46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "swap": 0}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:32.198073 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-483074ca-7eda-425a-a9c7-abc540288b46 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076116 Jun 03 16:08:32.199420 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:32.211557 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-3e1a7e99-a636-4863-be4f-12f9a077ae5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:32.238381 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-3e1a7e99-a636-4863-be4f-12f9a077ae5a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031218 Jun 03 16:08:32.247362 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Fri Jun 3 16:08:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:34.532012 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-483074ca-7eda-425a-a9c7-abc540288b46 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:34.533031 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-483074ca-7eda-425a-a9c7-abc540288b46 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 03 16:08:34.533431 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:34.602133 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a6163467-2cca-42ba-9876-f601614aa23e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:34.625035 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a6163467-2cca-42ba-9876-f601614aa23e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084855 Jun 03 16:08:34.625766 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Fri Jun 3 16:08:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:08:37.133513 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-483074ca-7eda-425a-a9c7-abc540288b46 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:37.134543 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-483074ca-7eda-425a-a9c7-abc540288b46 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 03 16:08:37.134944 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:37.194302 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-f5ad413a-edb2-4581-a2cf-e96c8e905d20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:37.214247 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-f5ad413a-edb2-4581-a2cf-e96c8e905d20 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073445 Jun 03 16:08:37.214808 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:37.227191 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-e3f7ddbc-0320-44f4-a14d-07e6a8fc5ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:37.251504 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-e3f7ddbc-0320-44f4-a14d-07e6a8fc5ba3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028609 Jun 03 16:08:37.252485 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Fri Jun 3 16:08:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:39.530717 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-f5ad413a-edb2-4581-a2cf-e96c8e905d20 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:39.532171 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-f5ad413a-edb2-4581-a2cf-e96c8e905d20 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Jun 03 16:08:39.532652 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:39.592489 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-b32eeff9-0ea0-44f9-9b26-f24af2153226 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:39.610224 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-b32eeff9-0ea0-44f9-9b26-f24af2153226 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071035 Jun 03 16:08:39.610882 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 16:08:39.622450 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-9f66e276-50ed-4629-a5ff-5ae503323e3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:39.645618 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-9f66e276-50ed-4629-a5ff-5ae503323e3c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026781 Jun 03 16:08:39.646186 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Fri Jun 3 16:08:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:42.056074 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-b32eeff9-0ea0-44f9-9b26-f24af2153226 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:42.057216 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-b32eeff9-0ea0-44f9-9b26-f24af2153226 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Jun 03 16:08:42.057694 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:42.115481 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a0f90e7c-9266-488a-a794-3a711e82a719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "swap": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:42.133097 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a0f90e7c-9266-488a-a794-3a711e82a719 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069698 Jun 03 16:08:42.133652 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:42.145303 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-3323e447-f39a-4179-930f-20b2d99d53cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:42.168560 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-3323e447-f39a-4179-930f-20b2d99d53cf admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026947 Jun 03 16:08:42.169131 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Fri Jun 3 16:08:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:08:44.429567 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a0f90e7c-9266-488a-a794-3a711e82a719 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:44.430598 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a0f90e7c-9266-488a-a794-3a711e82a719 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 03 16:08:44.430996 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:44.487843 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-ea0b9b46-bbee-4b63-bc01-9244faf081f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 80, "name": "m1.large"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:44.505235 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-ea0b9b46-bbee-4b63-bc01-9244faf081f9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068374 Jun 03 16:08:44.506095 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 16:08:44.518314 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-cc103497-9f68-4d49-9919-a6d52ab4a381 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:44.542153 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-cc103497-9f68-4d49-9919-a6d52ab4a381 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027507 Jun 03 16:08:44.542649 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Fri Jun 3 16:08:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:08:46.856783 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-ea0b9b46-bbee-4b63-bc01-9244faf081f9 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:08:46.857827 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-ea0b9b46-bbee-4b63-bc01-9244faf081f9 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 03 16:08:46.858419 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:08:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:08:46.921366 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-abac99cb-a537-4d14-af4f-7abebdfe35e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:46.949388 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-abac99cb-a537-4d14-af4f-7abebdfe35e3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082042 Jun 03 16:08:46.950835 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Fri Jun 3 16:08:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:08:46.963649 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-498552d7-b500-4061-bd59-7ddc977e93b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:08:46.988166 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-498552d7-b500-4061-bd59-7ddc977e93b3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028990 Jun 03 16:08:46.989015 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Fri Jun 3 16:08:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:09:11.229461 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-abac99cb-a537-4d14-af4f-7abebdfe35e3 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:11.230476 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-abac99cb-a537-4d14-af4f-7abebdfe35e3 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 03 16:09:11.230878 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:09:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:11.241350 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:09:11.291158 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1778bf52-7902-425d-8d06-93794ae13210 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:11.308684 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1778bf52-7902-425d-8d06-93794ae13210 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071940 Jun 03 16:09:11.309209 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Fri Jun 3 16:09:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:09:12.285152 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-abac99cb-a537-4d14-af4f-7abebdfe35e3 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:12.286189 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-abac99cb-a537-4d14-af4f-7abebdfe35e3 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 03 16:09:12.286592 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:12.486548 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-a7f70199-12d2-4d95-8154-a0696826187a admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:12.492212 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.wsgi [None req-a7f70199-12d2-4d95-8154-a0696826187a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-a7f70199-12d2-4d95-8154-a0696826187a admin admin] Request method failure captured: Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Accept: application/json Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Accept-Encoding: gzip, deflate Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Connection: keep-alive Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Content-Length: 0 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Host: 10.222.0.41 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Openstack-Api-Version: compute 2.90 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Openstack-System-Scope: None Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: User-Agent: python-novaclient Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Auth-Token: gAAAAABimjIo4DE_He0Ou12dqowPtcmcyxQkbedXQ0vY4Y6Yv-2ejoZ2yrRN11lF1SFkYN-mNLCXAjCwwo0vUjzWEe-yJAX6aXuHbynIZ5jH9Xeb_5cRfi6K2S-ICQKg6s77yt9XO9EqpK8p8aesKD4G9DjQh8n4wbvsbFdK7N7groRIU1Frqg4 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Domain-Id: None Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Domain-Name: None Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Identity-Status: Confirmed Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Is-Admin-Project: True Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Domain-Id: default Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Domain-Name: Default Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Name: admin Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Role: reader,admin,member Jun 03 16:09:12.495539 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Roles: reader,admin,member Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_450b64d0f10f4cb8949a26d9eea4aef4"}]}] Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant: admin Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant-Name: admin Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User: admin Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Domain-Id: default Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Domain-Name: Default Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Id: 5aca81affd5542cf9480c6e76c8c5478 Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Name: admin Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: method: > Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: exception: Flavor 42 could not be found. Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: action_args: {'id': '42'} Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:09:12.497192 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:12.498283 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.499936 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-a7f70199-12d2-4d95-8154-a0696826187a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:09:12.501211 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-a7f70199-12d2-4d95-8154-a0696826187a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060921 Jun 03 16:09:12.501211 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Fri Jun 3 16:09:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 16:09:12.506583 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-a9eeb4ca-81cb-4bf8-b802-e7c89f2fc312 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:12.509564 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:09:12.530006 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-a9eeb4ca-81cb-4bf8-b802-e7c89f2fc312 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027028 Jun 03 16:09:12.530595 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Fri Jun 3 16:09:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:09:12.540619 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8b63281c-f33d-4edc-a1ff-e0b9153f9831 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:12.561758 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-8b63281c-f33d-4edc-a1ff-e0b9153f9831 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025309 Jun 03 16:09:12.562284 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Fri Jun 3 16:09:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:09:12.571231 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-602db2f5-f248-4250-a623-3ee6cc471fb9 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:12.578559 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-602db2f5-f248-4250-a623-3ee6cc471fb9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-602db2f5-f248-4250-a623-3ee6cc471fb9 admin admin] Request method failure captured: Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Accept: application/json Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Connection: keep-alive Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Content-Length: 0 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Host: 10.222.0.41 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABimjIo4DE_He0Ou12dqowPtcmcyxQkbedXQ0vY4Y6Yv-2ejoZ2yrRN11lF1SFkYN-mNLCXAjCwwo0vUjzWEe-yJAX6aXuHbynIZ5jH9Xeb_5cRfi6K2S-ICQKg6s77yt9XO9EqpK8p8aesKD4G9DjQh8n4wbvsbFdK7N7groRIU1Frqg4 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Role: reader,admin,member Jun 03 16:09:12.581788 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Roles: reader,admin,member Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_450b64d0f10f4cb8949a26d9eea4aef4"}]}] Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant: admin Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User: admin Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Id: 5aca81affd5542cf9480c6e76c8c5478 Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Name: admin Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: method: > Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: exception: Flavor 42 could not be found. Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: action_args: {'id': '42'} Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:09:12.583119 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:12.583949 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:12.584950 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-602db2f5-f248-4250-a623-3ee6cc471fb9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:09:12.585976 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-602db2f5-f248-4250-a623-3ee6cc471fb9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015429 Jun 03 16:09:12.585976 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Fri Jun 3 16:09:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 16:09:13.440190 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-8b63281c-f33d-4edc-a1ff-e0b9153f9831 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:13.441200 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-8b63281c-f33d-4edc-a1ff-e0b9153f9831 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 03 16:09:13.441593 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:13.628221 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-48f31d1c-1a7b-473b-a661-04102a5af0b8 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:13.634176 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-48f31d1c-1a7b-473b-a661-04102a5af0b8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-48f31d1c-1a7b-473b-a661-04102a5af0b8 admin admin] Request method failure captured: Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Accept: application/json Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Connection: keep-alive Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Content-Length: 0 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Host: 10.222.0.41 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABimjIp7bTKggdu8cT4lVWxv3TPg5KuaPTHRyeUtuyjzviNPlJeWXx0XwimwSw3_iJcDUqK_SR6u3S4eOYmB9VJadF7zrrAz5sf0Muw7GOZ9RI1-XxNXMlpWTqb27cZ9cRuFW7WOdZ6r5pBNdsd1clVa4Cr8d_LDEIWgHH5gehu4JbZrt4 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Role: reader,admin,member Jun 03 16:09:13.635723 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Roles: reader,admin,member Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_450b64d0f10f4cb8949a26d9eea4aef4"}]}] Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant: admin Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User: admin Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Id: 5aca81affd5542cf9480c6e76c8c5478 Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Name: admin Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: method: > Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: exception: Flavor 84 could not be found. Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: action_args: {'id': '84'} Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:09:13.637233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:13.638183 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.639487 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-48f31d1c-1a7b-473b-a661-04102a5af0b8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:09:13.640702 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-48f31d1c-1a7b-473b-a661-04102a5af0b8 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059510 Jun 03 16:09:13.640702 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Fri Jun 3 16:09:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 16:09:13.646782 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-1992a350-5e23-4a9b-a283-c2ce31247c97 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:13.660591 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-1992a350-5e23-4a9b-a283-c2ce31247c97 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017378 Jun 03 16:09:13.661108 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Fri Jun 3 16:09:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:09:13.670512 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-1b36cbaa-01cd-4fed-83cf-574c1e781d2f admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:13.684790 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-1b36cbaa-01cd-4fed-83cf-574c1e781d2f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017598 Jun 03 16:09:13.685311 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Fri Jun 3 16:09:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:09:13.694021 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-abf6d64c-e6c7-4006-8e6f-8e349179dc42 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:13.699260 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.wsgi [None req-abf6d64c-e6c7-4006-8e6f-8e349179dc42 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-abf6d64c-e6c7-4006-8e6f-8e349179dc42 admin admin] Request method failure captured: Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Accept: application/json Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Accept-Encoding: gzip, deflate Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Connection: keep-alive Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Content-Length: 0 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Host: 10.222.0.41 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Openstack-Api-Version: compute 2.90 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Openstack-System-Scope: None Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: User-Agent: python-novaclient Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Auth-Token: gAAAAABimjIp7bTKggdu8cT4lVWxv3TPg5KuaPTHRyeUtuyjzviNPlJeWXx0XwimwSw3_iJcDUqK_SR6u3S4eOYmB9VJadF7zrrAz5sf0Muw7GOZ9RI1-XxNXMlpWTqb27cZ9cRuFW7WOdZ6r5pBNdsd1clVa4Cr8d_LDEIWgHH5gehu4JbZrt4 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Domain-Id: None Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Domain-Name: None Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Identity-Status: Confirmed Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Is-Admin-Project: True Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Domain-Id: default Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Domain-Name: Default Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Name: admin Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Role: reader,admin,member Jun 03 16:09:13.700785 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Roles: reader,admin,member Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_450b64d0f10f4cb8949a26d9eea4aef4"}]}] Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant: admin Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant-Name: admin Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User: admin Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Domain-Id: default Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Domain-Name: Default Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Id: 5aca81affd5542cf9480c6e76c8c5478 Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Name: admin Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: method: > Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: exception: Flavor 84 could not be found. Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: action_args: {'id': '84'} Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:09:13.702245 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:13.703177 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:13.704449 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-abf6d64c-e6c7-4006-8e6f-8e349179dc42 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:09:13.705670 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-abf6d64c-e6c7-4006-8e6f-8e349179dc42 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011555 Jun 03 16:09:13.705670 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Fri Jun 3 16:09:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 16:09:14.558718 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-1b36cbaa-01cd-4fed-83cf-574c1e781d2f admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:14.559765 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-1b36cbaa-01cd-4fed-83cf-574c1e781d2f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 03 16:09:14.560166 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:14.745244 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-69535f34-3cd7-4503-b507-244ae3ad3de0 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:14.751132 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.wsgi [None req-69535f34-3cd7-4503-b507-244ae3ad3de0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-69535f34-3cd7-4503-b507-244ae3ad3de0 admin admin] Request method failure captured: Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Accept: application/json Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Accept-Encoding: gzip, deflate Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Connection: keep-alive Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Content-Length: 0 Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Host: 10.222.0.41 Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Openstack-Api-Version: compute 2.90 Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Openstack-System-Scope: None Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: User-Agent: python-novaclient Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Auth-Token: gAAAAABimjIqGtVOnsdViCbYXgJs-ykSZPPxJjisDWmiMw2ypH8cVQl2QyQYmsHq8fY3t7u_nHZdE--sr3IwUuhBZ01HAnndbMa_BVUzsUxXhpnwd7ZG3FYfmdipxbiJRf5qossW7OPnfaO63vSweonW8hwYiNb_2uBaf6cHAhT3d9Q1Xn0vghk Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Domain-Id: None Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Domain-Name: None Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Identity-Status: Confirmed Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Is-Admin-Project: True Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Domain-Id: default Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Domain-Name: Default Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Project-Name: admin Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Role: reader,admin,member Jun 03 16:09:14.752689 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Roles: reader,admin,member Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_450b64d0f10f4cb8949a26d9eea4aef4"}]}] Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant: admin Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-Tenant-Name: admin Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User: admin Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Domain-Id: default Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Domain-Name: Default Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Id: 5aca81affd5542cf9480c6e76c8c5478 Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: X-User-Name: admin Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: method: > Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: exception: Flavor 451 could not be found. Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: action_args: {'id': '451'} Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:09:14.754275 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:14.755246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.756377 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-69535f34-3cd7-4503-b507-244ae3ad3de0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:09:14.757555 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-69535f34-3cd7-4503-b507-244ae3ad3de0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059047 Jun 03 16:09:14.757555 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Fri Jun 3 16:09:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 16:09:14.763968 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8f90db66-b563-417e-8926-f02192675261 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:14.779745 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8f90db66-b563-417e-8926-f02192675261 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019402 Jun 03 16:09:14.782100 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Fri Jun 3 16:09:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:09:14.791138 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:14.804801 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018102 Jun 03 16:09:14.805340 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Fri Jun 3 16:09:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:09:14.815061 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-e185a6f8-045c-4ed5-b952-2f9354d0b188 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:14.820507 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-e185a6f8-045c-4ed5-b952-2f9354d0b188 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-e185a6f8-045c-4ed5-b952-2f9354d0b188 admin admin] Request method failure captured: Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Accept: application/json Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Connection: keep-alive Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Content-Length: 0 Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Host: 10.222.0.41 Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABimjIqGtVOnsdViCbYXgJs-ykSZPPxJjisDWmiMw2ypH8cVQl2QyQYmsHq8fY3t7u_nHZdE--sr3IwUuhBZ01HAnndbMa_BVUzsUxXhpnwd7ZG3FYfmdipxbiJRf5qossW7OPnfaO63vSweonW8hwYiNb_2uBaf6cHAhT3d9Q1Xn0vghk Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Role: reader,admin,member Jun 03 16:09:14.822008 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Roles: reader,admin,member Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/450b64d0f10f4cb8949a26d9eea4aef4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_450b64d0f10f4cb8949a26d9eea4aef4"}]}] Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant: admin Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant-Id: 450b64d0f10f4cb8949a26d9eea4aef4 Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User: admin Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Id: 5aca81affd5542cf9480c6e76c8c5478 Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: X-User-Name: admin Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: method: > Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: exception: Flavor 451 could not be found. Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: action_args: {'id': '451'} Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:09:14.823623 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:14.824548 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Jun 03 16:09:14.826282 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-e185a6f8-045c-4ed5-b952-2f9354d0b188 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:09:14.827585 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-e185a6f8-045c-4ed5-b952-2f9354d0b188 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011918 Jun 03 16:09:14.827585 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Fri Jun 3 16:09:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 16:09:15.684215 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:15.685267 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 03 16:09:15.685668 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:15.871157 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-81fcc29e-017b-4cb0-8612-24e30a243826 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:09:15.888781 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-81fcc29e-017b-4cb0-8612-24e30a243826 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068428 Jun 03 16:09:15.889325 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Fri Jun 3 16:09:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:09:16.742828 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:16.743886 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 03 16:09:16.744276 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:16.929739 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-691ec166-dd12-4908-b3b1-099fa8a59dac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:09:16.948369 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-691ec166-dd12-4908-b3b1-099fa8a59dac admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070301 Jun 03 16:09:16.948920 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Fri Jun 3 16:09:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:09:17.806376 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:17.807414 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 03 16:09:17.807814 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:17.992228 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-cd1fa0b1-7d1d-43b2-bafa-ada420190b81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:09:18.009019 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-cd1fa0b1-7d1d-43b2-bafa-ada420190b81 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067114 Jun 03 16:09:18.009555 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Fri Jun 3 16:09:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:09:18.866952 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:18.868229 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jun 03 16:09:18.868662 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:19.056409 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-896440a9-7b61-4094-99ec-6bd4d70cf4db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:09:19.074009 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-896440a9-7b61-4094-99ec-6bd4d70cf4db admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069296 Jun 03 16:09:19.074540 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Fri Jun 3 16:09:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:09:19.933238 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:19.934246 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 03 16:09:19.934645 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:09:20.119637 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-6530003a-f41d-4cdc-9e53-aa1a66bf9534 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:09:20.138372 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-6530003a-f41d-4cdc-9e53-aa1a66bf9534 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069778 Jun 03 16:09:20.138902 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Fri Jun 3 16:09:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:10:20.717997 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:10:20.719008 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-d083a2bc-8912-4885-af7a-4c0e3435c483 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 03 16:10:20.719484 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Fri Jun 3 16:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:10:20.726471 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:10:20.779383 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-64016460-2406-4df6-9721-f34b33cf14b7 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:10:20.798575 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-64016460-2406-4df6-9721-f34b33cf14b7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073490 Jun 03 16:10:20.799098 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Fri Jun 3 16:10:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:10:20.819190 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG dbcounter [-] [103199] Writing DB stats nova_api:SELECT=14 {{(pid=103199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:10:20.822920 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-c1b79d50-2e9f-4ecc-a921-ece0855c900a admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:10:20.830594 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-c1b79d50-2e9f-4ecc-a921-ece0855c900a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012872 Jun 03 16:10:20.831125 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Fri Jun 3 16:10:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:10:20.842534 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-d14e117d-0f2a-44f3-89b5-8a915084c4c7 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:10:20.850371 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-d14e117d-0f2a-44f3-89b5-8a915084c4c7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011289 Jun 03 16:10:20.850894 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Fri Jun 3 16:10:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:10:20.862512 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:10:20.870096 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011105 Jun 03 16:10:20.870628 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Fri Jun 3 16:10:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:10:20.881380 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-6ee8c339-6d20-4347-acc7-86bfede0744a admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:10:20.888805 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-6ee8c339-6d20-4347-acc7-86bfede0744a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010862 Jun 03 16:10:20.889306 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Fri Jun 3 16:10:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:13:38.094358 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:38.095403 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 03 16:13:38.095809 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:13:38.252233 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=6 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:38.364747 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0cd4e0e2-60a1-498e-98b5-e68d52e262db admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:38.365939 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:13:38.365939 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 03 16:13:38.367152 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0cd4e0e2-60a1-498e-98b5-e68d52e262db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:38.367620 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0cd4e0e2-60a1-498e-98b5-e68d52e262db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:38.368406 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0cd4e0e2-60a1-498e-98b5-e68d52e262db admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:38.368832 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0cd4e0e2-60a1-498e-98b5-e68d52e262db admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:38.402004 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-0cd4e0e2-60a1-498e-98b5-e68d52e262db admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.151183 Jun 03 16:13:38.402552 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 36/70] 10.222.0.41 () {60 vars in 1193 bytes} [Fri Jun 3 16:13:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:13:39.273809 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:39.274857 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 03 16:13:39.275259 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 35/71] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:13:39.466165 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-3f82a896-3bf9-4c72-9de3-cf784a0dba1e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:39.468052 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:13:39.468052 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 03 16:13:39.469259 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-3f82a896-3bf9-4c72-9de3-cf784a0dba1e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:39.469717 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-3f82a896-3bf9-4c72-9de3-cf784a0dba1e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:39.470543 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-3f82a896-3bf9-4c72-9de3-cf784a0dba1e admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:39.470972 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-3f82a896-3bf9-4c72-9de3-cf784a0dba1e admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:39.491087 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-3f82a896-3bf9-4c72-9de3-cf784a0dba1e admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075214 Jun 03 16:13:39.491605 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 37/72] 10.222.0.41 () {60 vars in 1193 bytes} [Fri Jun 3 16:13:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:13:50.783142 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:50.784181 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 03 16:13:50.784579 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 36/73] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:13:50.927145 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=4 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.927892 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell1:SELECT=4 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.928505 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=8 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:13:50.977564 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-5b89297d-b1a7-4efc-a448-5ae88ea0779f admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:50.978804 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:13:50.978804 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 03 16:13:50.980081 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5b89297d-b1a7-4efc-a448-5ae88ea0779f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:50.980522 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5b89297d-b1a7-4efc-a448-5ae88ea0779f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:50.981310 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5b89297d-b1a7-4efc-a448-5ae88ea0779f admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:50.981739 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-5b89297d-b1a7-4efc-a448-5ae88ea0779f admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:51.006785 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-5b89297d-b1a7-4efc-a448-5ae88ea0779f admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083951 Jun 03 16:13:51.007261 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1193 bytes} [Fri Jun 3 16:13:50 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:13:51.869676 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: DEBUG nova.api.openstack.wsgi [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] Calling method '>' {{(pid=103199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:51.870680 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: INFO nova.api.openstack.requestlog [None req-bec09afe-a630-47d5-be63-f8804f38ff92 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 03 16:13:51.871078 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: [pid: 103199|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1074 bytes} [Fri Jun 3 16:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:13:52.059756 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-0a982f1d-77f8-4474-ba1f-76e0ab9d059e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:13:52.061519 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 16:13:52.061519 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Jun 03 16:13:52.062760 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0a982f1d-77f8-4474-ba1f-76e0ab9d059e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:52.063205 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0a982f1d-77f8-4474-ba1f-76e0ab9d059e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:52.064034 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0a982f1d-77f8-4474-ba1f-76e0ab9d059e admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:13:52.064463 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-0a982f1d-77f8-4474-ba1f-76e0ab9d059e admin admin] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:13:52.086132 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-0a982f1d-77f8-4474-ba1f-76e0ab9d059e admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078660 Jun 03 16:13:52.086625 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 39/76] 10.222.0.41 () {60 vars in 1193 bytes} [Fri Jun 3 16:13:52 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:14:49.570792 dv-cinder-836996-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 16:14:49.571561 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: Fri Jun 3 16:14:49 2022 - graceful shutdown triggered... Jun 03 16:14:49.572091 dv-cinder-836996-28-iscsi devstack@n-api.service[103199]: Gracefully killing worker 2 (pid: 103199)... Jun 03 16:14:49.572459 dv-cinder-836996-28-iscsi devstack@n-api.service[103198]: Gracefully killing worker 1 (pid: 103198)... Jun 03 16:14:50.572773 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: worker 1 buried after 1 seconds Jun 03 16:14:50.572773 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: worker 2 buried after 1 seconds Jun 03 16:14:50.572773 dv-cinder-836996-28-iscsi devstack@n-api.service[103197]: goodbye to uWSGI. Jun 03 16:14:50.574291 dv-cinder-836996-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 16:14:50.574853 dv-cinder-836996-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 16:14:50.577619 dv-cinder-836996-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 16:14:50.591039 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 16:14:50 2022] *** Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: nodename: dv-cinder-836996-28-iscsi Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: machine: x86_64 Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: clock source: unix Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: pcre jit disabled Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: detected number of CPU cores: 4 Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: current working directory: / Jun 03 16:14:50.614080 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: detected binary path: /usr/bin/uwsgi-core Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: your processes number limit is 47680 Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: your memory page size is 4096 bytes Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: detected max file descriptor number: 2048 Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: lock engine: pthread robust mutexes Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: thunder lock: enabled Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 16:14:50.614839 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 16:14:50.663470 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: Python main interpreter initialized at 0x56124ccb99c0 Jun 03 16:14:50.663470 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: python threads support enabled Jun 03 16:14:50.663470 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: your server socket listen backlog is limited to 100 connections Jun 03 16:14:50.663470 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: your mercy for graceful operations on workers is 90 seconds Jun 03 16:14:50.663994 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 16:14:50.663994 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: *** Operational MODE: preforking *** Jun 03 16:14:50.664138 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: *** uWSGI is running in multiple interpreter mode *** Jun 03 16:14:50.664138 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: spawned uWSGI master process (pid: 117548) Jun 03 16:14:50.664351 dv-cinder-836996-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 16:14:50.666645 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: spawned uWSGI worker 1 (pid: 117570, cores: 1) Jun 03 16:14:50.666645 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: spawned uWSGI worker 2 (pid: 117571, cores: 1) Jun 03 16:14:50.666645 dv-cinder-836996-28-iscsi devstack@n-api.service[117548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 16:14:51.886569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 16:14:51.898961 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 16:14:52.736477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:14:52.736477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: from cryptography.utils import int_from_bytes Jun 03 16:14:52.736789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:14:52.736789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: from cryptography.utils import int_from_bytes Jun 03 16:14:52.736925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:14:52.736925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: from cryptography.utils import int_from_bytes Jun 03 16:14:52.737047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 16:14:52.737047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: from cryptography.utils import int_from_bytes Jun 03 16:14:55.176071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 16:14:55.176644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 16:14:55.176854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 16:14:55.177216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 16:14:55.177472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 16:14:55.177858 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.178184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.178505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.178823 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.179250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.179711 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.180175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.180604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.181084 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.181445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.181882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.182348 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-28-iscsi {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.182678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.182988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.183338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.183783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.184203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.184659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.185107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.185827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.186423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.186744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.187065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.187513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.187953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.188382 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.188857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.189309 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.189738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.190197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.190825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-28-iscsi {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.191155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.191501 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.191888 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.192256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.192558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.192883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.193196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.193523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.193830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.194328 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.195042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.195638 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.196126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.196363 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.196676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.196994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.197302 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.197612 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.197921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.198175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.198489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.198815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.199139 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.199489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.199744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.200003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.200323 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.200648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.200960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.201269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.201598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.201910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.202216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.202526 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.202836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.203145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.203490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.203812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.204136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.204446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.204769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.205171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.205424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.205733 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.206076 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.206396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.206707 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.207026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.207385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.207697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.208006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.208313 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.208634 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.208931 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 16:14:55.209401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.209535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 16:14:55.209664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.209664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.209920 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 16:14:55.210060 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.210199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 16:14:55.210329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.210463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 16:14:55.210593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.210728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.210869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211139 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211488 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.211903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212663 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212797 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.212925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.213111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.213288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.213432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.213570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.213708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.213922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.214055 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.214227 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.214500 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-28-iscsi {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.214644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.214853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.215065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.215178 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.215588 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.215712 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.215966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.216120 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.216297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.216509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.216628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.216846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.216957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.217158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.217757 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.217987 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.218259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.218367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.218582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.218749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.218883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219039 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219339 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.219945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.220170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.220264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.220479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.220587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.220789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.220881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.221105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.221203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.221414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.221508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.221720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.221814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-28-iscsi {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222127 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222425 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.222947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.223129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.223279 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.223489 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.223649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.223795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.223948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.224107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.224259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.224415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.224559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.224718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.224878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.225110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.225262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.225417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.225570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.225721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.225881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.226034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.226186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.226339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.226482 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.226739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.227050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.227213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.227394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.227543 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.227696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.227855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.228001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.228144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.228287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.228430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.228573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.228734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.228879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.229034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.229186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.229347 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.229577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.229727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.229863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.229995 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.229995 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.230249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.230392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.230524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.230653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.230791 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.230921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.231050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.231195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.231389 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.231522 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.231659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.231799 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.231937 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.232078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.232222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.232352 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.232490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.232627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.232767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.232976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.233594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.233724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.233853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.234012 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.234161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.234294 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.234432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.234571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.234708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.234843 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.234987 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.235192 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.235493 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.235612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.235706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.235802 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.235908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.236161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.236397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.236499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.236801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.236946 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.237114 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.237434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.237533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.237887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.237987 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.238227 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.238404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.238548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.238729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.238866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.239048 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.239183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.239414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.239628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.239798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.239957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.240165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.240340 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.240496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.240640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.240791 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.240934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.241076 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.241229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.241380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.241525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.241668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.241813 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.241966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.242122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.242265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.242416 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.242561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.242711 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.242934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.243081 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.243223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.243389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.243533 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.243678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.243833 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.243995 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.244140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.244283 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.244434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.244577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.244734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.244879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.245029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.245179 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.245352 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.245579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.245731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.245875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.246037 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.246192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.246350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.246503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.246650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.246827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.247050 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.247415 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.247592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.247751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.247905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.248049 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.248201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.248368 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.248540 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.248701 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.248859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.249011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.249164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.249321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.249467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.249618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.249618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.250005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.250159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.250317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.250472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.250624 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.250776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.250928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.251072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.251229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.251397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.251543 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.252260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.252419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.252565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.252709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.252709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.253008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.253154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.253306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.253459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.253602 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.253746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.253897 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.254040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.254202 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.254354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.254506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.254660 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.254802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.254802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.255082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.255235 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.255418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.255583 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.255803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.255961 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.256115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.256269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.256442 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.256663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.256824 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.256979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.257161 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 16:14:55.257463 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.257613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.257761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.257761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258052 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258209 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258498 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258652 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.258807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.259113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.259259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.259259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.259580 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.259741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.259981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.260133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.260279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.260279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.260572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.260726 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.260882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261185 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.261938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262082 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262673 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.262982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.263134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.263288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.263487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.263634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.263786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.263931 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.264094 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.264261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.264407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.264568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.264714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.264868 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265019 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265325 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.265991 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.266151 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.266303 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.266448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.266591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.266742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.266904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.267058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.267202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.267443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.267613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.267764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.267921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268066 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.268976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.269129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.269280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.269423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.269565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.269805 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.269979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.270197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.270355 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.270508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.270659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.270659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.270962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.271107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.271259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.271475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.271632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.271784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.271937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.272092 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.272244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.272244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.272537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.272690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.272842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273293 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.273888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274040 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274498 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.274957 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.275117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.275263 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.275431 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.275576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.275729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.275881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.276122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.276282 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.276435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.276580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.276731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.276875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.277039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.277233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.277429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.277586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.277734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.277886 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.278041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.278186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.278330 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.278481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.278633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.279055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.279204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.279401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.279401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.279690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.280448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.280448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.280741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.280893 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281756 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.281901 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282044 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282194 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.282952 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.283111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.283263 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.283433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.283599 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.283761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.283905 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284649 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.284950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285389 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285531 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285838 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.285996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.286228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.286378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.286530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.286689 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.286845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.286997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.287148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.287319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.287472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.287639 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.287793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.287936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288838 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.288981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.289130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.289281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.289281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.289572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.289726 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.289878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.290022 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.290197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.290392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.290635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.290786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.290930 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.291074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.291237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.291419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.291565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.291718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.291870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292014 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.292913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293207 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293502 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293663 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.293950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.294101 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.294252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.294428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.294623 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.294771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.294914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.295057 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.295200 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.296038 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.296227 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.296446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.296594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.296738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.296890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.297044 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.297190 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.297359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.297612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.297773 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.297933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.298085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.298242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.298401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.298401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.298680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.298905 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.299059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.299229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.299473 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.299619 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.299762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.299918 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.300072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.300224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.300368 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.300523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.300767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.300929 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301964 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.301964 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.302242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.302387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.302550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.302550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.302829 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.302979 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.303131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.303282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.303471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.303625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.303769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.303919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.304974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.305260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.305404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.305556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.305708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.305862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.306016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.306161 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.306314 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.306483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.306702 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.306851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307158 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.307983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.308138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.308290 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.308445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.308595 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.308754 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.308900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309044 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309187 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309483 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.309937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.310081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.310224 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.310376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.310530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.310687 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.310924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.311128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.311284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.311472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.311627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.311780 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.311933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.312085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.312229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.312382 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.312544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.312696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.312849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.313883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314027 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314330 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314635 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314780 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.314939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.315085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.315236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.315434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.315591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.315744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.315903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.316049 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.316193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.316347 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.316498 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.316642 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.316883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317036 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317349 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317799 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.317945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.318230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.318384 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.318528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.318681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.318826 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.318826 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319717 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.319898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320358 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.320947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321195 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321405 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321727 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.321999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.322165 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.322480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.322608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.322816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.322921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.323161 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.323316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.323525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.323651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.323878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.323979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.324196 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.324297 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.324517 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.324618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.324830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.324923 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.325144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.325236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.325463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.325556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.325772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.325870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.326083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.326195 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.326394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.326503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.326728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.326831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327376 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.327999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.328183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.328340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.328570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.328734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.328887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.329046 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.329197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.329354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.329521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.329674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.329832 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330313 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330634 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.330954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.331204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.331411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.331582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.331582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.331872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.332964 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.333121 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.333281 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.333432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.333601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.333761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.333920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.334080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.334244 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.334396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.334396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.334688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.334849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.335000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.335163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.335334 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.335504 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.335663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.335814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.336049 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.336221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.336380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.336539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.336690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.336841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.337018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.337243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.337407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.337559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.337717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.337882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.338078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.338258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.338411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.338562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.338720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.338880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.339046 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.339198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.339404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.339564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.339714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.339875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.340034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.340187 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.340418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.340575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.340765 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.340938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.341098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.341361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.341361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.341676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.341837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.342002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.342002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.342830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.342993 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.342993 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.343332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.343511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.343511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.343798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.343798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.344104 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.344270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.344429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.344588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.344739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.344889 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.345046 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.345217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.345395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.345684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.345857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346652 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346652 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.346944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.347104 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.347350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.347514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.347665 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.347815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.347964 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.348128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.348288 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.348440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.348591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.348742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.348899 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.349064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.349216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.349378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.349530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.349688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.349847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350467 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.350946 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.351097 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.351247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.351434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.351587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.351751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.351904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.352062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.352213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.352364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.352529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.352695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.352847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353157 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.353938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.354201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.354362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.354609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.354779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.354940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.355099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.355099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.355099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.355099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.355099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.355876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356028 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356186 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.356960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.357253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.357414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.357584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.357736 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.357968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.358627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.358786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.358954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.359107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.359266 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.359444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.359597 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.359761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.359914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360522 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360683 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360835 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.360984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.361279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.361442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.361594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.361771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.361987 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.362144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.362315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.362479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.362631 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.362782 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.362940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.363908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.364223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.364396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.364549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.364700 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.364858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365330 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365649 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.365973 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.366132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.366295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.366461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.366613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.366764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.366923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.367075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.367225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.367429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.367591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.367741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.367906 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.368058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.368216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.368387 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.368549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.368701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.368866 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369190 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369493 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.369967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.370117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.370275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.370446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.370613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.370765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.370922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.371082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.371234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.371435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.371760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.372076 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.372235 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.372395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.372554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.372725 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.372892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.373052 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.373204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.373356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.373544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.373711 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.373863 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374490 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.374972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.375132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.375284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.375503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.375667 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.375820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.375973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.376132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.376285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.376446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.376606 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.376773 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.376933 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.377091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.377249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.377415 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.377575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.377735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.377921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.378081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.378242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.378395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.378547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.378708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.378861 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.379013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.379173 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.379429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.379598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.379751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.379902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.380062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.380224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.380377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.380528 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.380688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.380851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.381958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.382113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.382264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.382524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.382706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.382870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.383031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.383193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.383422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.383581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.383733 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.383894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.384057 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.384368 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.384533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.384684 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.384994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.385163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.385387 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.385555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.385715 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.385992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.386152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.386316 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.386467 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.386626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.386786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.386939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.387098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.387261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.387446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.387625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.387785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.387945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.388104 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.388266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.388426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.388577 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.388727 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.388878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.389029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.389717 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.389878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.390043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.390270 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.390436 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.390635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.390790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.390950 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.391102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.391253 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.391450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.391616 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.391777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.391940 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.392101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.392272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.392424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.392598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.392752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.392910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.393062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.393213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.393373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.393525 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.393686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.393846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.394007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.394167 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.394339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.394492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.394661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.394864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.395019 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.395182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.395482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.395657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.395813 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.395972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.396124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.396274 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.396450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.396603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.396603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.396892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397366 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397666 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397824 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.397976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.398200 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.398354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.398516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.398668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.398828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.399025 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.399202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.399387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.399557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.399710 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.399863 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400335 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400493 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.400994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.401154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.401306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.401464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.401624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.401777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.401939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.402101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.402261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.402414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.402564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.402729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.402896 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.403058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.403219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.403406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.403567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.403726 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.404151 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.404312 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.404483 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.404636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.404857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.405516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.405516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.405823 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.405983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406286 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.406970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.407265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.407452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.407452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.407760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.407760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408369 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.408980 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.409145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.409298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.409459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.409621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.409772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.409922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410672 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.410992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.411144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.411342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.411514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.411666 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.411828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.411990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.412142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.412292 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.412444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.412594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.412754 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.412914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.413065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.413215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.413373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.413535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.413767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.413922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.414073 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.414233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.414385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.414537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.414698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.414850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.415000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.415159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.415336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.415529 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.415696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.415848 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416321 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416485 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.416954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.417105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.417265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.417435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.417595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.417748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.417900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.418059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.418220 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.418372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.418531 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.418691 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.418851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.419010 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.419175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.419356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.419525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.419684 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.419845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.420006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.420167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.420341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.421956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.422109 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.422269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.422432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.422592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.422744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.422894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.423053 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.423219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.423423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.423423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.423721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.423890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424500 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.424975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.425144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.425305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.425470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.425633 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.425786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.425951 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.426134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.426289 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.426440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.426591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.426591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.426887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.427047 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.427200 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.427381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.427540 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.427691 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.427691 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428637 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.428953 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.429111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.429269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.429421 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.429579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.429857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430346 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430816 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.430968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.431126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.431277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.431473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.431640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.431806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.431958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.432126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.432278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.432429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.432594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.432756 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.432908 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.433059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.433219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.433379 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.433547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.433706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.433858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.434946 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.435098 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.435258 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.435463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.435627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.435788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.435968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.436668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.436911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.437066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.437218 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.437377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.437535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.437697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.437856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438316 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438803 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.438962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.439123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.439276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.439453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.439617 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.439617 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.439908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.440068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.440228 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.440386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.440547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.440699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.440868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441624 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.441945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.442097 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.442262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.442262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.442560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.442722 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.442874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.443033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.443197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.443376 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.443534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.443694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.443845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.444808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 16:14:55.445122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.445287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.445574 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.445850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.446188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.446502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.446815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.447127 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.447556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.448089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.448628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.449217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.449579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.449907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.450232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.450555 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.450878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.451199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.451704 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.452073 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.452535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.453034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.453547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.453918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.454262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.454603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.454964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.455270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.455738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.456068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.456395 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.456751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.457082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.459360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.459360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.459360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.459360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.459360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.459360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.460329 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.460329 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.460329 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.460786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.460786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.461258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.461587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.461929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.462280 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.462925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.463277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.463790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.464113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.464430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.464750 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.465079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.465405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.465827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.466379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.466702 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.467019 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.467458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.467776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.468091 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.468416 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.468725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.469039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.469435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.469748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.470060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.470371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.470685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.471004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.471429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.471743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.472054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.472364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.472983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.473345 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.473850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.474190 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.474509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.474839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.475160 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.475522 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.475965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.476297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.476614 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.476955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.477303 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.477998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.478319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.478647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.478962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.479281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.479640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.479977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.480292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.480627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.480983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.481311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.481634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.481952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.482289 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.482607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.483713 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.484041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.484427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.484756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.485084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.485409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.485745 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.486189 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.486515 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.486848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.487185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.487570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.487891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.488243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.488581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.488904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.489222 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.489534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 16:14:55.489782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 16:14:55.507624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO dbcounter [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Registered counter for database nova_api Jun 03 16:14:55.527829 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_db.sqlalchemy.engines [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.535618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writer thread running {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.552215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO dbcounter [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Registered counter for database nova_api Jun 03 16:14:55.573262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_db.sqlalchemy.engines [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.580530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writer thread running {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.596675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.context [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3aa4319c-5fbd-4b59-928b-816489450cee(cell1) {{(pid=117570) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 16:14:55.600934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:14:55.602559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:14:55.603400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:14:55.605384 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:14:55.607418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO dbcounter [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Registered counter for database nova_cell0 Jun 03 16:14:55.612167 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO dbcounter [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Registered counter for database nova_cell1 Jun 03 16:14:55.619549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_db.sqlalchemy.engines [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.621878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_db.sqlalchemy.engines [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.628539 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writer thread running {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.633557 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writer thread running {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.644417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.context [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3aa4319c-5fbd-4b59-928b-816489450cee(cell1) {{(pid=117571) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 16:14:55.648845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:14:55.650615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:14:55.651529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:14:55.653563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:14:55.656050 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO dbcounter [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Registered counter for database nova_cell0 Jun 03 16:14:55.660190 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO dbcounter [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Registered counter for database nova_cell1 Jun 03 16:14:55.667806 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_db.sqlalchemy.engines [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.671084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_db.sqlalchemy.engines [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.679482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writer thread running {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.681376 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writer thread running {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.786544 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO dbcounter [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Registered counter for database nova_cell0 Jun 03 16:14:55.793410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_db.sqlalchemy.engines [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.798224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writer thread running {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:55.832077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO dbcounter [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Registered counter for database nova_cell0 Jun 03 16:14:55.839007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_db.sqlalchemy.engines [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 16:14:55.843855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writer thread running {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 16:14:56.241470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: WARNING keystonemiddleware.auth_token [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:14:56.249138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: WARNING keystonemiddleware.auth_token [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:14:56.277743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: WARNING keystonemiddleware.auth_token [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:14:56.285951 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: WARNING keystonemiddleware.auth_token [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:14:56.477167 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: WARNING keystonemiddleware.auth_token [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:14:56.483308 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: WARNING keystonemiddleware.auth_token [None req-4425b0f5-489b-46d0-b2ea-bafd6895ef27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:14:56.488425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56124ccb99c0 pid: 117570 (default app) Jun 03 16:14:56.518067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: WARNING keystonemiddleware.auth_token [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 16:14:56.524004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: WARNING keystonemiddleware.auth_token [None req-51ca052b-8a5a-49a1-bdab-b299cb74ab22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 16:14:56.529379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56124ccb99c0 pid: 117571 (default app) Jun 03 16:15:41.149374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:41.150305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:41.151087 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:41.155326 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:42.048113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1519464084", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "networks": [{"uuid": "d7dfdfc9-0dda-4bea-8c8d-33e7e10f86c9"}]}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:15:42.988607 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] validate_networks() for [('d7dfdfc9-0dda-4bea-8c8d-33e7e10f86c9', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:15:46.295373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:15:46.296978 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:15:46.298141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:15:46.298911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:15:46.299734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:15:46.364779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:46.366486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:46.373321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:46.374128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:46.513002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Getting quotas for project b1dde95632be44e29e77bfddc2ad84b5. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:15:46.538563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Getting quotas for user 34ca0974e6dd49bdb6a56ec577dad3cb and project b1dde95632be44e29e77bfddc2ad84b5. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:15:46.597745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:15:46.608482 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:15:46.829332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8e5b86fa-41fe-46d1-a2fc-b145957555ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.686479 Jun 03 16:15:46.835212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:15:47.532047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dc99c0d1-e7ab-44ec-ae6f-7799305ceab3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:15:47.532774 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dc99c0d1-e7ab-44ec-ae6f-7799305ceab3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:15:47.577960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:47.579051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:47.579784 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:47.580623 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:48.300184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dc99c0d1-e7ab-44ec-ae6f-7799305ceab3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:15:48.346765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dc99c0d1-e7ab-44ec-ae6f-7799305ceab3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1215 microversion: 2.1 time: 1.508866 Jun 03 16:15:48.352401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 1/2] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:15:46 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1215 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:15:49.373999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:15:49.375921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:15:49.417716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:49.419379 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:49.422252 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:49.423527 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:50.162013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-392c0bc8-979d-4dc0-bb3f-696e512c3d68 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'create', calling method: .version_select at 0x7fb5c2b1cee0>, body: {"keypair": {"name": "tempest-keypair-127922057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4ajvV6/9nJfHygpk7CwXX3gY48k+aekK2t14JLLFVxMZtgUsdCnj7pYWtaHTlP2FuYzy+EXkUE4ZXWoloyScNAJ9u10g+qZfruev0TS1YKlB8DFg0zYjVVj3xVhXsCdw=="}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:15:50.258285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:15:50.298050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9d213df5-8f31-45e7-b934-3b3f5fa07698 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1267 microversion: 2.1 time: 0.932101 Jun 03 16:15:50.302237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:15:49 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1267 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:15:50.339094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-392c0bc8-979d-4dc0-bb3f-696e512c3d68 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:15:50.364456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-392c0bc8-979d-4dc0-bb3f-696e512c3d68 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for user 94f91ae071b24e31a8ef8d50933ba4fb and project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:15:50.504853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-392c0bc8-979d-4dc0-bb3f-696e512c3d68 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.918424 Jun 03 16:15:50.511078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 2/4] 10.222.0.41 () {62 vars in 1199 bytes} [Fri Jun 3 16:15:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 920 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 16:15:51.319810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:15:51.320506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:15:51.333749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:51.335153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:51.337983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:51.339399 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:52.452350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-861aaf33-8a6d-48fc-9a27-ecce171a3cc3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: .version_select at 0x7fb5c2a9d310>, body: {"keypair": {"name": "tempest-keypair-729770790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0/bxCXiUb3GBb8YlpPaWXx1kS2ECteThlJp4Kn6SfJlESkrAQkJMrW77uzBW3AUdtFbXDucoXa9tATIJHhONoeJSujipQpShOdemPbtM+oz2spPXww6RQ9Gxs8FT1zyA=="}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:15:52.504489 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-861aaf33-8a6d-48fc-9a27-ecce171a3cc3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:15:52.522175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-861aaf33-8a6d-48fc-9a27-ecce171a3cc3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:15:52.586734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-861aaf33-8a6d-48fc-9a27-ecce171a3cc3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.704481 Jun 03 16:15:52.587622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 3/5] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:15:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:15:52.766162 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:15:52.782765 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5c6c9cab-d47e-43fb-b4a5-bcbbb9db76ad tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1273 microversion: 2.1 time: 1.464442 Jun 03 16:15:52.793820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 3/6] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:15:51 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1273 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:15:53.801006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:15:53.802114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:15:53.818177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:53.818801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:53.821793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:53.823668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:54.311592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:15:54.332844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-69bda2d1-07f3-44a8-a202-ecdd444c786d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1273 microversion: 2.1 time: 0.535942 Jun 03 16:15:54.344359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:15:53 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1273 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:15:55.351573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:15:55.352252 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:15:55.379376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:55.379983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:55.380876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:55.381363 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:56.425266 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:15:56.434547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6d7c0979-e331-48e5-92e3-f8164bb11616 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1273 microversion: 2.1 time: 1.087482 Jun 03 16:15:56.444072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:15:55 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1273 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:15:57.458770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:15:57.459616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:15:57.480801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:57.481851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:57.485758 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:15:57.489444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:15:57.746513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:57.747325 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=6 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:15:58.587772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-892973674", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:15:58.734059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] validate_networks() for [('6e0aaf95-4836-425b-942f-acfb7d3ce506', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:15:58.978474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:15:58.992730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cd7004ab-836e-4a27-8b4f-a2d1b0ffad58 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 1.535686 Jun 03 16:15:59.002799 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 5/9] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:15:57 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:00.021998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:00.023409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:00.032155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:00.034811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:00.039232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:00.040281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:01.229975 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:01.242335 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5fe92a02-c087-4815-a37e-b8f0334b317a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 1.226891 Jun 03 16:16:01.249102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 6/10] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:00 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:02.270001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:16:02.271277 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:16:02.272118 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:16:02.272944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:16:02.273532 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:16:02.312300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:02.316535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:02.317718 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:02.320954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:02.376460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for project 1443b802dc724950b5eb5c6446e2515c. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:16:02.391214 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for user 4206a21c317e4b5aace8541699f8032d and project 1443b802dc724950b5eb5c6446e2515c. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:16:02.395611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-84a360b1-a02b-4b81-b652-437c8de71059 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: .version_select at 0x7fb5c219b550>, body: {"keypair": {"name": "tempest-keypair-879553497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8k2QRH4xjj4raetu3BOto0NcoCYEw7cvs4Ve5IHkwJtECQZJD22PbZisb6wRSQcptObzX2jtDSTDKIVKXMhB8X8ESk1MmxFB81ldSKG1/mrsaztyuWg3i4nizxr5WV0g=="}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:02.426976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:16:02.434009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-84a360b1-a02b-4b81-b652-437c8de71059 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for project d0f59694966848829048aee648dddccc. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:16:02.434902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:16:02.455813 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-84a360b1-a02b-4b81-b652-437c8de71059 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for user c68189df1f9b4f9aacfa319381849697 and project d0f59694966848829048aee648dddccc. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:16:02.542818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-96baba3a-4292-4318-b0d3-e6af94e1a94b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.801287 Jun 03 16:16:02.549604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 5/11] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:15:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:16:02.561197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:02.563461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-84a360b1-a02b-4b81-b652-437c8de71059 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.993165 Jun 03 16:16:02.565082 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:02.565948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 7/12] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:16:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:16:02.590085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-43da7c16-c22d-4284-a2d1-82da793a7046 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:02.591359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-43da7c16-c22d-4284-a2d1-82da793a7046 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:02.598889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:02.600627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:02.602196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:02.605531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:02.818273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-43da7c16-c22d-4284-a2d1-82da793a7046 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:02.833664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-43da7c16-c22d-4284-a2d1-82da793a7046 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1221 microversion: 2.1 time: 0.264431 Jun 03 16:16:02.840668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 8/13] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:02 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1221 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:02.860520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-995380548", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aac77ef2-24df-4348-b770-e983d0529c48"}], "security_groups": [{"name": "tempest-securitygroup--702785982"}], "key_name": "tempest-keypair-127922057", "user_data": "}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:03.460767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] validate_networks() for [('aac77ef2-24df-4348-b770-e983d0529c48', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:16:03.714380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:03.744935 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e6aed3f5-6165-4c34-99db-c0730feab420 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 1.193907 Jun 03 16:16:03.752091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 6/14] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:02 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:03.772031 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1429825297", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb749c5-3e3e-449b-80a2-fa7c692f9d8e"}], "security_groups": [{"name": "tempest-securitygroup--1950194867"}], "key_name": "tempest-keypair-729770790", "user_data": "}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:04.601101 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] validate_networks() for [('6fb749c5-3e3e-449b-80a2-fa7c692f9d8e', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:16:06.171470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:16:06.172020 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:16:06.173622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:16:06.174133 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:16:06.174807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:16:06.209247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:06.209718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:06.210557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:06.211007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:06.326718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:16:06.342128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for user 94f91ae071b24e31a8ef8d50933ba4fb and project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:16:06.385750 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:16:06.399698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:16:06.555971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6501fa12-95c4-4078-9b1f-60632da9b472 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.713275 Jun 03 16:16:06.557250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 9/15] 10.222.0.41 () {62 vars in 1187 bytes} [Fri Jun 3 16:16:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 3716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 16:16:06.569412 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-884931745", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:06.733450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] validate_networks() for [('6e0aaf95-4836-425b-942f-acfb7d3ce506', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:16:06.744832 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:16:06.746472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:16:06.747145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:16:06.747774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:16:06.748371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:16:06.776977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:06.776977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:06.779319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:06.780033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:06.823080 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:16:06.829004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:16:06.875102 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:16:06.881067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:16:07.000241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ea3c8f7a-1ef9-4445-b99f-1043797047d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.244640 Jun 03 16:16:07.003479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 7/16] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:16:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:16:07.017487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:07.018238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:07.034333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:07.036108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:07.037021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:07.038619 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:07.468612 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:07.484261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b96a3ba0-21bd-4897-8f27-e89271679b8f tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.478216 Jun 03 16:16:07.485110 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 8/17] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:07 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:07.965847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-4bcb094e-0deb-4dad-9dbf-d56f853239ca req-0a6bafb7-f70f-4185-a634-897f2089567e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd398f1-b836-4cf5-9735-ed63505630a7", "tag": "faed89f2-da2d-4cf7-b471-15a07783c520"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:07.991457 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-4bcb094e-0deb-4dad-9dbf-d56f853239ca req-0a6bafb7-f70f-4185-a634-897f2089567e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.006679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-4bcb094e-0deb-4dad-9dbf-d56f853239ca req-0a6bafb7-f70f-4185-a634-897f2089567e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.067224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-4bcb094e-0deb-4dad-9dbf-d56f853239ca req-0a6bafb7-f70f-4185-a634-897f2089567e service nova] Creating event network-changed:faed89f2-da2d-4cf7-b471-15a07783c520 for instance bdd398f1-b836-4cf5-9735-ed63505630a7 on hv-cinder-83699 Jun 03 16:16:08.069506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-4bcb094e-0deb-4dad-9dbf-d56f853239ca req-0a6bafb7-f70f-4185-a634-897f2089567e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 16:16:08.071088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.072280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.074491 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.075618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.110708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.compute.rpcapi [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 16:16:08.114086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] Releasing lock "compute-rpcapi-router" {{(pid=117570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 16:16:08.126100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:16:08.126554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:16:08.127152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:16:08.137363 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:16:08.138460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:16:08.178391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2c4452cf-8b26-48b0-99aa-b8abda93a511 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.689732 Jun 03 16:16:08.179008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 9/18] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:16:08.186339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.189689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.194232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.194705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.207221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:08.211223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:08.231507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.232286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.236512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.237457 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.253091 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for project 1443b802dc724950b5eb5c6446e2515c. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:16:08.265919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for user 4206a21c317e4b5aace8541699f8032d and project 1443b802dc724950b5eb5c6446e2515c. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:16:08.297673 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:16:08.306785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:16:08.390117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:08.404179 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:08.406514 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:08.407813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cd6e102b-22fa-4256-a8ca-e7cdcad7c679 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1284 microversion: 2.20 time: 0.220012 Jun 03 16:16:08.427779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 10/19] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:08 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:08.438350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:08.440995 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:08.451485 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a9a780bb-852c-4478-b938-50b4058542fa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.888984 Jun 03 16:16:08.458527 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 10/20] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:16:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:16:08.462677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.463863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.465772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.469026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.473002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a67a0ea2-48bb-4479-b60a-adc82feb92aa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:08.476036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a67a0ea2-48bb-4479-b60a-adc82feb92aa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:08.591877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:08.603877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d7d80227-c611-42e3-90db-563d68ec6f2d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1245 microversion: 2.1 time: 0.174494 Jun 03 16:16:08.605713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 11/21] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:08 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1245 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:08.611223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:08.612963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:08.632769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a67a0ea2-48bb-4479-b60a-adc82feb92aa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:08.640279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a67a0ea2-48bb-4479-b60a-adc82feb92aa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1221 microversion: 2.1 time: 0.179936 Jun 03 16:16:08.654147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:08 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:08.655563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.657154 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.659192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:08.659997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:08.832902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:08.844461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7b293f5e-4d0b-418d-a5b8-dfbb95b8c4f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.236433 Jun 03 16:16:08.845387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 12/23] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:08 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:09.180009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-809620306", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3619401-b67f-424d-9ca5-3555aafbaad6"}], "security_groups": [{"name": "tempest-securitygroup--1116560862"}], "key_name": "tempest-keypair-879553497", "user_data": "}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:09.369965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] validate_networks() for [('c3619401-b67f-424d-9ca5-3555aafbaad6', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:16:09.427232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:09.428488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:09.436599 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:09.439477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:09.440464 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:09.442897 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:09.515466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:09.524672 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:09.526219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:09.532766 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-641dc63b-502c-4ee5-9f60-1f212a295dcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1284 microversion: 2.20 time: 0.109304 Jun 03 16:16:09.539387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 13/24] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:09 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:09.628192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:09.631055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:09.643328 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:09.644670 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:09.645938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:09.646584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:09.726088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:09.738224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-26390787-bcd6-4735-829b-b3d47ccf84c2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1245 microversion: 2.1 time: 0.120203 Jun 03 16:16:09.739928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 14/25] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:09 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:09.761159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:09.764098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:09.790893 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:09.793315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:09.794817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:09.799248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:09.991371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.017078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ae6b5c42-86ba-4a4f-b4ac-2c4ecdf9567e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1225 microversion: 2.1 time: 0.275031 Jun 03 16:16:10.017920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 15/26] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:09 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1225 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:10.049262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:10.053953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:10.083669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.084471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.087355 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.087868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.106962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:16:10.107429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:16:10.108089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:16:10.108510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:16:10.109054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:16:10.125882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.129572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.130825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.131547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.188342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for project d0f59694966848829048aee648dddccc. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:16:10.207551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for user c68189df1f9b4f9aacfa319381849697 and project d0f59694966848829048aee648dddccc. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:16:10.213159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:10.236377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:16:10.243521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:16:10.337510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-90e8c965-710c-4a10-ba6f-cb73297d99fe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.163079 Jun 03 16:16:10.341486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.343484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 12/27] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:16:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:16:10.352637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4cc4ff51-bb44-489e-ae3c-a109cb83bb41 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.333107 Jun 03 16:16:10.353076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c4e45cfa-2607-4998-8770-3395b1a0f4be tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:10.353575 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 16/28] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:10 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:10.354554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c4e45cfa-2607-4998-8770-3395b1a0f4be tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:10.447457 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c4e45cfa-2607-4998-8770-3395b1a0f4be tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.455739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c4e45cfa-2607-4998-8770-3395b1a0f4be tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1236 microversion: 2.1 time: 0.110573 Jun 03 16:16:10.458315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 13/29] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:10 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:10.551596 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:10.552215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:10.559395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.560827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.561968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.562590 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.649834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.662951 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.665273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.667133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0b640d35-1d16-4bad-8db3-fee1b97bc63a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1284 microversion: 2.20 time: 0.120608 Jun 03 16:16:10.668768 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 17/30] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:10 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:10.757672 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:10.758396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:10.765734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.766124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.766909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:10.767507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:10.833239 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:10.841216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c3426a2f-9e30-4458-8f39-fb834185a38b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1245 microversion: 2.1 time: 0.087659 Jun 03 16:16:10.842450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 14/31] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:10 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:11.035184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:11.036009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:11.044812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.045597 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.046620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.047206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.201645 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.217826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-59718389-da11-4186-81f4-3d38d0936efa tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1225 microversion: 2.1 time: 0.187304 Jun 03 16:16:11.218730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 18/32] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:11 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1225 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:11.369888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:11.371811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:11.378491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.378949 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.383629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.384090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.479269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:11.484402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:11.489683 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:11.510573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.514784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.515759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.518126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.552721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.562979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=95 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:11.563511 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bafb8e11-5216-4c5b-8424-530abf9ade3a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.196981 Jun 03 16:16:11.564182 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 15/33] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:11 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:11.635633 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.647089 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e78ef1c4-cc4e-4108-9c9f-9d8cadc70ebf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1240 microversion: 2.1 time: 0.175445 Jun 03 16:16:11.647928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 19/34] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:11 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1240 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:11.687923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:11.688549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:11.695027 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.695883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.696697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.697141 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.762764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.772642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.775603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.777203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3944d770-bbd9-4295-a142-5511cf5932de tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1284 microversion: 2.20 time: 0.094654 Jun 03 16:16:11.778267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 16/35] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:11 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:11.858413 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:11.859032 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:11.865028 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.865477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.866242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:11.866676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:11.925551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:11.933497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e8a3e361-f796-46a3-a6dc-09949574790f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1245 microversion: 2.1 time: 0.078905 Jun 03 16:16:11.934056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 20/36] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:11 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:12.233741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:12.234384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:12.240313 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.240767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.241529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.241966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.300876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:12.308616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e558baef-d1a8-42c7-83d2-04f6ce038142 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1225 microversion: 2.1 time: 0.078189 Jun 03 16:16:12.309164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 17/37] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:12 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:12.580652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:12.581196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:12.587159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.587654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.588447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.588883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.664514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:12.665200 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:12.671871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.672328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.673110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.673550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.719948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:12.727406 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1e1b016d-ce62-4018-ad41-bee892baa446 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.150699 Jun 03 16:16:12.727966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 21/38] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:12 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:12.736126 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:12.743647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a95be4aa-2068-4b82-a38a-d6126e09961f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1240 microversion: 2.1 time: 0.082897 Jun 03 16:16:12.744207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 18/39] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:12 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:12.795900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:12.796545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:12.802496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.802949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.803761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.804199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.868708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:12.879313 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:12.880839 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:12.882026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-83b1975d-a1dd-4d21-8351-d0604c767022 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1284 microversion: 2.20 time: 0.090489 Jun 03 16:16:12.882658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 22/40] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:12 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:12.950040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:12.950655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:12.956581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.957072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:12.957841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:12.958283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.024661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:13.032967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0c4d59d2-8a34-4239-863d-5298c353a5bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1245 microversion: 2.1 time: 0.086821 Jun 03 16:16:13.033532 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 19/41] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:12 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:13.325281 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:13.325899 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:13.332002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.332460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.333247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.333693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.404624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:13.412130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fbc47d8a-98aa-43ef-b6cf-90c816c7a025 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1225 microversion: 2.1 time: 0.090741 Jun 03 16:16:13.412690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 23/42] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:13 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:13.744703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:13.745822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:13.752326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.752788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.753697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.754071 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.761748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:13.762335 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:13.778867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.779840 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.781378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.781378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.855480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:13.863592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fda3b508-a684-4c90-982a-542989a42f90 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1240 microversion: 2.1 time: 0.106533 Jun 03 16:16:13.864172 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 24/43] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:13 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:13.899917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:13.900778 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:13.907440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.908023 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.908908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:13.909447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:13.934952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:13.945225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-40b4ab2b-fc84-45f7-aeb0-5920a218617d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.204351 Jun 03 16:16:13.956486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 20/44] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:13 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:14.036894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:14.051657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:14.053317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:14.053930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:14.054635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:14.058541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9a6bdf94-47f2-435a-89a2-f0dbbdc3024f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1284 microversion: 2.20 time: 0.162185 Jun 03 16:16:14.061296 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 25/45] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:13 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:14.073238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.074984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.075998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.076582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.170079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:14.178691 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b266a4e3-68a7-4345-91e6-e5f5b8d1ec03 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1237 microversion: 2.1 time: 0.128998 Jun 03 16:16:14.179369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 21/46] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:14 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:14.435186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:14.436118 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:14.443914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.444588 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.446174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.446972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.522474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:14.530581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8ca92bee-39b1-4f7b-b4d4-6b086ac7bb46 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1217 microversion: 2.1 time: 0.105432 Jun 03 16:16:14.531153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 26/47] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:14 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:14.880909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:14.881536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:14.888299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.888756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.889534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.889989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.964804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:14.965244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:14.966024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:14.972166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.972616 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:14.972720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c673aadc-a6fd-4281-abff-e35b3cf51463 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.095552 Jun 03 16:16:14.973187 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 22/48] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:14 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:14.973376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:14.973810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.079204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:15.079923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:15.086359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.086809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.087630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.088072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.119026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:15.126842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-98ec104a-9c88-40a2-b69f-564670cb4221 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.167238 Jun 03 16:16:15.127435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 27/49] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:14 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:15.151175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:15.160001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:15.161515 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:15.162611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-25ab8f3e-991d-4d37-9c12-ab6ef7e60b31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.088305 Jun 03 16:16:15.163166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 23/50] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:15 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:15.196966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:15.197590 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:15.204466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.204910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.205691 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.206123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.268576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:15.275869 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7329c6e6-0b34-4188-bbe3-b3f53ff5448c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.082899 Jun 03 16:16:15.276451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 28/51] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:15 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:15.548976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:15.549888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:15.556034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.556491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.557270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.557739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.622609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:15.629965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c637d59e-0d9f-4975-a2d0-866f4c06a72c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.084865 Jun 03 16:16:15.630521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 24/52] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:15 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:15.989579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:15.990220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:15.997563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.998006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:15.998793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:15.999220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.063206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.071287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d4eaf738-ceba-4dd4-b3bb-ec6f4335f290 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.085504 Jun 03 16:16:16.071871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 29/53] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:15 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:16.144208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:16.144863 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:16.150885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.151356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.152124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.152565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.179568 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:16.180177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:16.186542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.186990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.187770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.188201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.248924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.257085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.258609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.259740 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7c58e6dd-f7f1-46ec-81e2-dc31f73b8d66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.083936 Jun 03 16:16:16.260290 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 30/54] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:16 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:16.279642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.286968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dad7c682-e127-4ddb-8cd3-5519223b0a02 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.146672 Jun 03 16:16:16.287577 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 25/55] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:16 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:16.293719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:16.294359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:16.300473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.300921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.301681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.302122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.361648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.368917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-66b8a159-f253-4dd7-9cd5-f2c092d18fb8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.078989 Jun 03 16:16:16.369475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 31/56] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:16 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:16.647816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:16.648434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:16.654656 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.655106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.655928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:16.656365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:16.674379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:16.722054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:16.729368 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3fecbfcb-9a2f-4f39-9559-af8928075ade tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.085430 Jun 03 16:16:16.730510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 26/57] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:16 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:17.088020 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:17.088637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:17.090963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=12 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:17.096554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.097001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.097763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.098195 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.158455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.165700 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f124c511-6107-44ad-9924-cc0411508277 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.081516 Jun 03 16:16:17.166260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 32/58] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:17 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:17.278912 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:17.279611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:17.285616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.286063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.286827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.287267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.303698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:17.304341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:17.310618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.311065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.311873 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.312308 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.351705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.359728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.361231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.362337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8df1077c-9e31-426e-ad40-a4193b686629 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.088274 Jun 03 16:16:17.362902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 27/59] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:17 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:17.385606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:17.386740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:17.392837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.393294 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.394065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.394508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.441846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.449724 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f359cda6-ffcb-48a6-9ee2-1b63cf4dd85d tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.149827 Jun 03 16:16:17.450362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 33/60] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:17 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:17.454972 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.462326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b81bc0e4-3849-4cfb-b21f-83fc0a6d9e4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.080439 Jun 03 16:16:17.462870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 28/61] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:17 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:17.747284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:17.747862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:17.753806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.754273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.755033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:17.755506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:17.818660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:17.826678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-006651fb-2712-41a3-844a-f368defec174 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.083835 Jun 03 16:16:17.827236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 34/62] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:17 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:18.183876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:18.184480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:18.190426 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.190884 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.191690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.192124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.252336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.259860 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-de57536d-a7a7-4c8b-9a4c-f94689d3ab70 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.079768 Jun 03 16:16:18.260460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 29/63] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:18 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:18.380156 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:18.380801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:18.382701 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=6 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:18.389003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.389451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.390252 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.390694 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.450159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.452607 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:18.459658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.461186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.462294 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f45ef0dc-8b99-4c69-b128-a956ef80ac78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.086040 Jun 03 16:16:18.462851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 35/64] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:18 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:18.465873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:18.466494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:18.472467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.472917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.473734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.474176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.479280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:18.479930 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:18.485933 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.486386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.487157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.487629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.548813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.557337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-320cb47b-7466-4947-a863-1ddf9030a376 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.081615 Jun 03 16:16:18.558445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 36/65] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:18 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:18.608825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.616198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8e6087bb-695f-4791-8216-93f96987e410 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.154168 Jun 03 16:16:18.616766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 30/66] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:18 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:18.843753 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:18.844286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:18.850372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.850817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.851605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:18.852044 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:18.915614 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:18.923582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b928a537-22c4-47bc-bf76-fa654900b8b4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.083879 Jun 03 16:16:18.924231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 37/67] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:18 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:19.279323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:19.279967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:19.286397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.286849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.287662 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.288102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.357874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:19.365298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b9943a51-f447-45f4-a7dd-32e8944a4da4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.091862 Jun 03 16:16:19.365869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 31/68] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:19 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:19.480398 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:19.480938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:19.486834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.487278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.488069 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.488506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.548131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:19.556198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:19.557696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:19.558782 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c554c8b8-1b4d-4692-9ab0-4a7d9e491da5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.082466 Jun 03 16:16:19.559363 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 38/69] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:19 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:19.575439 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:19.576053 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:19.581996 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.582449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.583210 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.583680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.633931 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:19.634554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:19.641194 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.641642 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.642561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.642874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.644913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:19.653207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2b9795ee-da54-4537-b5bf-ed2cd6846983 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.081352 Jun 03 16:16:19.653833 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 32/70] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:19 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:19.769605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:19.777006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5199f220-9ab8-4db9-b80a-084ec8060604 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.147948 Jun 03 16:16:19.777570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 39/71] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:19 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:19.940947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:19.941555 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:19.947570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.948016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:19.949414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:19.949847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.009225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.017251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-240d94b6-a22b-4cf7-9d6f-354991c41f0f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.080102 Jun 03 16:16:20.017742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 33/72] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:19 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:20.381991 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:20.382509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:20.388480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.388922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.389667 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.390096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.454837 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.462226 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-886a80b6-1cbc-4f0b-bbb9-88059ae084e7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.084175 Jun 03 16:16:20.462785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 40/73] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:20 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:20.576237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:20.576882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:20.578716 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=6 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:20.579414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=38 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:20.585259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.585706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.586473 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.586912 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.649087 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.657707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.659214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.660344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fe678ef1-1949-4c7b-a04f-65a0a6b6e0d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.088036 Jun 03 16:16:20.660902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 34/74] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:20 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:20.670836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:20.671495 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:20.677759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.678213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.679003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.679479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.744396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.751813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0818888b-b13b-43b7-9656-dde2e17f927e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.085521 Jun 03 16:16:20.752549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 41/75] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:20 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:20.794812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:20.795566 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:20.801665 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.802120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.802892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:20.803367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:20.938300 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:20.945757 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f4788ca7-9259-4908-8cd4-1fc8e0a7d335 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.155687 Jun 03 16:16:20.946315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 35/76] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:20 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:21.034526 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:21.035246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:21.041332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.041724 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.042499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.042938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.104909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:21.112560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0ef6ea98-451a-4745-9ba8-57576492272a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.082022 Jun 03 16:16:21.113113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 42/77] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:21 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:21.479736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:21.480385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:21.487238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.487727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.488501 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.488964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.548261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:21.555528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a7dd8adf-1297-4998-a2b0-4e5511fdd70c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.079566 Jun 03 16:16:21.556090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 36/78] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:21 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:21.678387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:21.678999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:21.685182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.685630 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.686392 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.686829 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.750728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:21.758829 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:21.760315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:21.761448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b38fab69-61cd-4af6-971a-0f8d39be0135 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.086991 Jun 03 16:16:21.762222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 43/79] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:21 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:21.770551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:21.771188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:21.777608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.778974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.779785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.780223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.839427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:21.847487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-111cf09b-8dbb-4097-89ec-d0687cc7d9fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.081271 Jun 03 16:16:21.848046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 37/80] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:21 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:21.963206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:21.963836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:21.969760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.970203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:21.970945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:21.971417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.102624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.110143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-99d41727-157d-409c-9d3c-0d2f51757bb1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.150727 Jun 03 16:16:22.110704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 44/81] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:21 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:22.129418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:22.130028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:22.136011 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.136454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.137213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.138215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.209391 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.215109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9d5ffe60-8867-4b7e-ad59-7383e33ad4d5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.089426 Jun 03 16:16:22.216071 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 38/82] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:22 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:22.573245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:22.574367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:22.581471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.581921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.582693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.583121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.644997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.652368 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f43cb84f-06e4-4b1f-aa63-0c01a903e5da tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.084001 Jun 03 16:16:22.653699 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 45/83] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:22 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:22.780590 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:22.781198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:22.787180 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.787656 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.788417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.788848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.864409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:22.865245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:22.871241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.871715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.873190 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:22.873429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:22.875569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.883599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.885109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.886411 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fd43d9e8-8a59-4d61-a45e-1483bfdda6f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.109977 Jun 03 16:16:22.886964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 39/84] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:22 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:22.935394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:22.945949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f8cd3c0f-9495-4564-9fe4-d55941326469 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.085221 Jun 03 16:16:22.946603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 46/85] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:22 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:23.128492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:23.130057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:23.137807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.138555 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.139446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.139921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.235449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:23.236484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:23.242814 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.243433 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.244799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.245242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.297707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:23.308230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5362acd1-36b7-472c-b40e-2f4edd881ee5 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.184831 Jun 03 16:16:23.308797 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 40/86] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:23 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:23.323022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:23.331575 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f58a3e48-09dd-4fe6-bc46-4d47af42d41d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.100765 Jun 03 16:16:23.341312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 47/87] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:23 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:23.670315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:23.670927 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:23.676963 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.677349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.678112 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.678545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.742018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:23.749381 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-35edb37c-e19b-40de-a72b-ea6719e87636 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.083441 Jun 03 16:16:23.749961 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 41/88] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:23 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:23.905827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:23.906501 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:23.917019 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.917815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.918925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.919529 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.963638 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:23.964232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:23.971214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.971699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.972924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:23.973495 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:23.994702 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.003571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.005463 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.006726 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-67238319-fafc-4884-89b4-73a72c0902f6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.105639 Jun 03 16:16:24.007406 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 48/89] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:23 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:24.045739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.053941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0a0b4e8a-680a-4f95-88a3-4a01c5e126e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.094386 Jun 03 16:16:24.054506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 42/90] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:23 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:24.326628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:24.327514 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:24.334425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:24.335090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:24.335995 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:24.336437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:24.348646 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:24.349608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:24.356140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:24.356907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:24.357830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:24.358535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:24.363237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:24.424552 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.432575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-341ab2bf-0dc1-422d-9def-8bc921ffcbc4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.087696 Jun 03 16:16:24.443606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 43/91] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:24 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:24.483213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.491130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b7191242-8003-491e-a466-8bf23452cfb7 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.169174 Jun 03 16:16:24.491717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 49/92] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:24 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:24.766976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:24.768046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:24.773998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:24.774450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:24.775496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:24.776104 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:24.854260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:24.862232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4ccfd344-3c2e-4d56-b576-451807a12c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.100085 Jun 03 16:16:24.862852 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 44/93] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:24 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:25.025216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:25.025834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:25.032496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.032943 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.033697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.034126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.070940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:25.071603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:25.077601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.078048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.078812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.079273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.097192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.105241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.107365 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.108468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a81bb45a-3754-4b46-9e71-5b8cb59b3de9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.087174 Jun 03 16:16:25.109027 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 50/94] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:25 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:25.140109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.147551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-38cd9593-b4a2-4955-80a3-12240d67846a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.080322 Jun 03 16:16:25.148110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 45/95] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:25 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:25.451808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:25.452450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:25.458387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.458835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.459625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.460066 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.508299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:25.508906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:25.515418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.515870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.516630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.517069 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.519808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.527142 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-50c4ec04-32d1-4b9e-8eec-7bba2ddd48cf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1281 microversion: 2.1 time: 0.079637 Jun 03 16:16:25.527731 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 51/96] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:25 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:25.642414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.649783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e0f7023b-b9b8-4f57-959c-c936b75a1443 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.145304 Jun 03 16:16:25.650342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 46/97] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:25 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:25.879126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:25.879892 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:25.885861 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.886312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.887070 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:25.888099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:25.902511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:25.948511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:25.956794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ebc5cce8-eff9-441a-9bb2-a815bb614204 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.081405 Jun 03 16:16:25.957364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 52/98] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:25 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:26.126547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:26.127157 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:26.133147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.133623 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.134376 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.134810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.164860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:26.165668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:26.172413 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.172934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.173764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.174267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.200333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:26.208549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:26.210091 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:26.211178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2e748ab3-f183-4db1-a3d8-d7acf3b3b3ba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.089155 Jun 03 16:16:26.211766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 47/99] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:26 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:26.235942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:26.243214 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d8ac577c-445c-4689-bad0-5b3212cf1bc5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.082175 Jun 03 16:16:26.243914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 53/100] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:26 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:26.545456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:26.546344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:26.552843 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.553478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.554253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.554850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.621963 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:26.630184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-654a2e0a-c64e-44e8-8fa6-238e10d31a82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1291 microversion: 2.1 time: 0.089093 Jun 03 16:16:26.630757 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 48/101] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:26 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1291 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:26.667811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:26.669197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:26.686162 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.686727 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.691456 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.693605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.973176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:26.973705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:26.980841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.981297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:26.982087 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:26.982560 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.048318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.056023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fe679c83-a344-4232-9a2d-15badfde6aaf tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.086739 Jun 03 16:16:27.056601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 49/102] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:26 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:27.074323 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.082218 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0351a18c-af62-4b57-9b46-2e6de3105790 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.418808 Jun 03 16:16:27.083231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 54/103] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:26 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:27.228821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:27.229509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:27.235892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:27.236469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.237332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:27.237853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.260080 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:27.260692 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:27.267554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:27.268199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.268963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:27.269546 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.311907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.320801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.322311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.323463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8d51012f-137f-4d97-bbad-8cdccd44cd4f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.098622 Jun 03 16:16:27.326837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 50/104] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:27 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:27.340935 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.348996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9eb0751f-3688-4d84-a1dc-6f398aa433c4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.092686 Jun 03 16:16:27.349979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 55/105] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:27 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:27.647181 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:27.647815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:27.654108 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:27.654554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.655333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:27.655775 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:27.715064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:27.722444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8e01777f-afa5-49c3-98ae-cfe6fdd6ec47 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1291 microversion: 2.1 time: 0.079153 Jun 03 16:16:27.722996 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 51/106] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:27 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1291 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:28.072358 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:28.073001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:28.078939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.079413 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.080174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.080607 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.099307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:28.099939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:28.105885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.107003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.107807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.108249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.142057 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.149515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-afeb81d7-26e3-4b60-b4c2-35d852e4f6d8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.080958 Jun 03 16:16:28.150077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 56/107] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:28 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:28.235324 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.242696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-70e6aa8f-d0e6-4db0-b4dc-19adcccbc956 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.147168 Jun 03 16:16:28.243256 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 52/108] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:28 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:28.341613 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:28.342243 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:28.348180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.348629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.349386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.349822 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.366102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:28.366853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:28.372893 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.373430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.374438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.374963 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.411340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.419535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.420979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.422098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0e5454c3-81e5-46c1-8c75-c6ff2a9693e9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1332 microversion: 2.20 time: 0.084961 Jun 03 16:16:28.422648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 57/109] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:28 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1332 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:28.440762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.448209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7fb53dcb-1cd8-4b1d-b911-ae51aa832eb0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1301 microversion: 2.1 time: 0.086289 Jun 03 16:16:28.448763 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 53/110] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:28 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:28.740212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:28.740751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:28.747243 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.747717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.748476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:28.748907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:28.833194 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:28.841682 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-803ed8c4-5be0-4f72-a4ce-605b29722f68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1291 microversion: 2.1 time: 0.105777 Jun 03 16:16:28.842480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 58/111] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:28 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1291 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:29.167385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:29.168090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:29.174564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.175017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.175816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.176260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.245719 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:29.281016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-187755bf-eb5f-4245-ad1d-6e08e148b018 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1288 microversion: 2.1 time: 0.117600 Jun 03 16:16:29.281813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:29.282595 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:29.290697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 54/112] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:29 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:29.303615 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.305907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.306656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.307388 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.445618 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:29.446250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:29.458247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.471698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.473620 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.474111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.581160 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:29.589927 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:29.592375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:29.593558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8399d2b7-b06d-4b88-ae2c-53de8b7cd347 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1340 microversion: 2.20 time: 0.156937 Jun 03 16:16:29.594118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 55/113] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:29 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1340 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:29.599999 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:29.600753 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:29.607491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.607940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.608710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.609145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.681743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:29.695443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d8ce7f9c-8e42-4097-aa13-9891c63c977b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.438630 Jun 03 16:16:29.696385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 59/114] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:29 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:29.816443 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:29.823859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-537f3413-f41e-40f1-921a-353721086c26 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1299 microversion: 2.1 time: 0.228806 Jun 03 16:16:29.824421 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 56/115] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:29 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:29.863556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:29.864249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:29.871428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.871951 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:29.872776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:29.873275 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.109328 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:30.122582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-548ab39d-de60-4229-b219-e447af31c725 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1279 microversion: 2.1 time: 0.259956 Jun 03 16:16:30.123204 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 60/116] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:29 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:30.310235 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:30.311041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:30.318289 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.318839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.319730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.320269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.394438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:30.404825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c315ed95-5751-4a1c-9934-bbd8053b07cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1294 microversion: 2.1 time: 0.109918 Jun 03 16:16:30.405619 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 57/117] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:30 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:30.613111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:30.613963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:30.621961 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.623090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.624147 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.624809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.715176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:30.716626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:30.720378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:30.725880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.726478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.727637 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.728205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.785560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:30.802268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:30.804265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:30.805342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-97367458-1e84-4d78-8a3a-bfafe2022ff1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1338 microversion: 2.20 time: 0.197071 Jun 03 16:16:30.816611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 61/118] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:30 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:30.844351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:30.845136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:30.854204 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.854649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:30.855492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:30.856455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.116009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:31.125749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2707df40-4ad9-49b9-b73f-2700afa1ed62 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.416135 Jun 03 16:16:31.135871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 58/119] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:30 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:31.142657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:31.143570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:31.150651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.151456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.152448 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.153367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.171364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:31.193519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-73232110-1535-4e7d-a2a9-b098ade22c04 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1299 microversion: 2.1 time: 0.352371 Jun 03 16:16:31.194091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 62/120] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:30 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1299 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:31.254847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:31.257504 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:31.263741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3cbd220e-1b50-4cab-bb66-2b67082c67b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1279 microversion: 2.1 time: 0.126179 Jun 03 16:16:31.273219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 59/121] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:31 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:31.423869 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:31.424512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:31.437128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.437914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.438934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.439682 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.444687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-49ff437a-8588-4bbb-938f-df932248607c req-84ea35bd-a271-4ba0-a787-5bcb5e1d191d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03", "tag": "db97c3da-b633-48cb-8479-c740ca53cd00"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:31.525826 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-49ff437a-8588-4bbb-938f-df932248607c req-84ea35bd-a271-4ba0-a787-5bcb5e1d191d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.531861 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-49ff437a-8588-4bbb-938f-df932248607c req-84ea35bd-a271-4ba0-a787-5bcb5e1d191d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.597021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-49ff437a-8588-4bbb-938f-df932248607c req-84ea35bd-a271-4ba0-a787-5bcb5e1d191d service nova] Creating event network-changed:db97c3da-b633-48cb-8479-c740ca53cd00 for instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 on hv-cinder-83699 Jun 03 16:16:31.597923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-49ff437a-8588-4bbb-938f-df932248607c req-84ea35bd-a271-4ba0-a787-5bcb5e1d191d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 16:16:31.599627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.600295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.601344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.602003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.629648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.compute.rpcapi [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 16:16:31.633122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] Releasing lock "compute-rpcapi-router" {{(pid=117571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 16:16:31.677800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1538a4bb-d95b-4a51-b9a5-6a57117e6a97 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238200 Jun 03 16:16:31.678739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 60/122] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:16:31.825844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:31.827038 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:31.843831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.844601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:31.847350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:31.848899 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.058101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.068317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.070063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.071200 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-919370b6-bf94-4b91-8802-254990726006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1338 microversion: 2.20 time: 0.250754 Jun 03 16:16:32.072449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 61/123] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:31 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1338 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:32.140861 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.150301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c7bae769-37a9-495f-872a-c89eef538f9a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.732029 Jun 03 16:16:32.164276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 63/124] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:31 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:32.174321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:32.175037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:32.190856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-32bdfc95-64a0-46b7-aa3b-fd950b1c794e req-342c79dc-275f-44f1-8b0c-b573faab9663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd398f1-b836-4cf5-9735-ed63505630a7", "name": "network-vif-plugged", "status": "completed", "tag": "faed89f2-da2d-4cf7-b471-15a07783c520"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:32.200489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.200924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.201720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.202155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.211048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-32bdfc95-64a0-46b7-aa3b-fd950b1c794e req-342c79dc-275f-44f1-8b0c-b573faab9663 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.211699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-32bdfc95-64a0-46b7-aa3b-fd950b1c794e req-342c79dc-275f-44f1-8b0c-b573faab9663 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.514505 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-32bdfc95-64a0-46b7-aa3b-fd950b1c794e req-342c79dc-275f-44f1-8b0c-b573faab9663 service nova] Creating event network-vif-plugged:faed89f2-da2d-4cf7-b471-15a07783c520 for instance bdd398f1-b836-4cf5-9735-ed63505630a7 on hv-cinder-83699 Jun 03 16:16:32.520759 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-32bdfc95-64a0-46b7-aa3b-fd950b1c794e req-342c79dc-275f-44f1-8b0c-b573faab9663 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.446838 Jun 03 16:16:32.522159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 62/125] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:16:32.528682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:32.529664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:32.537269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.538072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.539087 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.540114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.545720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.560704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5ddfaac3-183d-4bd6-994b-13a9ec7fd7b3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.394239 Jun 03 16:16:32.561293 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 64/126] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:32 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:32.569766 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:32.569766 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:32.586054 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.588912 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.591329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:32.592745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:32.823612 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.833739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-035ec0a9-8217-460e-a9ae-b2c5c3f23c3b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.271322 Jun 03 16:16:32.834697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 65/127] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:32 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:32.844646 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:32.855341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fb6af989-ca5a-430b-9424-3437d44d4df1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.331635 Jun 03 16:16:32.856544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 63/128] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:32 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:33.089936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:33.091390 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:33.102258 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.102706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.103520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.103955 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.175099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-062d4f90-47c9-4c53-8151-8dd5c4e61c76 req-a8eea0db-7bcd-49f9-b8d4-9338ef8c9dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de1f638-4fee-41e2-bd50-b802f8494fad", "tag": "fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:33.186637 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-062d4f90-47c9-4c53-8151-8dd5c4e61c76 req-a8eea0db-7bcd-49f9-b8d4-9338ef8c9dd5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.187089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-062d4f90-47c9-4c53-8151-8dd5c4e61c76 req-a8eea0db-7bcd-49f9-b8d4-9338ef8c9dd5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.198820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-062d4f90-47c9-4c53-8151-8dd5c4e61c76 req-a8eea0db-7bcd-49f9-b8d4-9338ef8c9dd5 service nova] Creating event network-changed:fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c for instance 2de1f638-4fee-41e2-bd50-b802f8494fad on hv-cinder-83699 Jun 03 16:16:33.204255 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-062d4f90-47c9-4c53-8151-8dd5c4e61c76 req-a8eea0db-7bcd-49f9-b8d4-9338ef8c9dd5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087783 Jun 03 16:16:33.204855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 64/129] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:16:33.209823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:33.210523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:33.217636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.218089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.218871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.219319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.254305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:33.264270 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:33.266396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:33.267738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2760b49a-4725-4e8b-ba0e-0a5264c03eb7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.181660 Jun 03 16:16:33.268828 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 66/130] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:33 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:33.364878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:33.372664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bde1c714-f3b5-438d-9604-d3b55ffd86b3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.166733 Jun 03 16:16:33.373252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 65/131] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:33 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:33.577844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:33.578441 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:33.584443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.584902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.585668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.586105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.717432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:33.724759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-37ecfea8-4f54-4bbd-9995-270a77859afb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.150824 Jun 03 16:16:33.725333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 67/132] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:33 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:33.850509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:33.851117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:33.857622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.858064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.858820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.859255 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.872382 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:33.872925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:33.878765 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.879216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.880015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:33.880451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:33.986765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:33.994273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2a7aaf4f-b545-422f-99f5-9ff00e95b1b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.147513 Jun 03 16:16:33.994850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 66/133] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:33 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:34.007084 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:34.014503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b84d9659-400b-45b5-ba60-8f7e8e9721cf tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.146645 Jun 03 16:16:34.015058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 68/134] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:33 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:34.285890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:34.286527 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:34.292600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:34.293048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:34.294447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:34.294879 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:34.389381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:34.390000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:34.391862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:34.397055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:34.397509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:34.398286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:34.398719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:34.403728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:34.423278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:34.431358 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:34.432871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:34.434007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5004d2dc-a61a-452e-9bbf-1d3971cbbc74 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.152010 Jun 03 16:16:34.434562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 67/135] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:34 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:34.527036 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:34.535763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c8a14d4a-5f1d-493e-81a9-d4eb3ce8df57 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.150632 Jun 03 16:16:34.536339 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 69/136] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:34 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:34.741764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:34.742314 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:34.748759 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:34.749207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:34.750000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:34.750436 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:34.878584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:34.885874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-21916059-2cdf-438c-9d1e-ebe66dacf33c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.147921 Jun 03 16:16:34.886426 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 68/137] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:34 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:35.011173 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:35.011744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:35.018380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.018844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.019640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.020077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.030225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:35.030830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:35.036837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.037285 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.038064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.038471 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.148812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:35.157249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8bc90068-e98a-465c-a526-3defa4d86fe5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.149925 Jun 03 16:16:35.157852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 70/138] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:35 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:35.173418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:35.180747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1e27a090-967a-4f3c-a660-feba5c7ff4ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.154533 Jun 03 16:16:35.181445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 69/139] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:35 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:35.451550 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:35.452159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:35.458294 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.458732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.459511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.459938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.552945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:35.553562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:35.559948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.560398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.561177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.561618 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.698133 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:35.705576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a6c6365a-1f24-4dff-8524-372be6cd4a71 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.156478 Jun 03 16:16:35.706136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 70/140] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:35 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:35.733409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:35.741248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:35.742758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:35.743891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a5c62653-de1c-478e-80f4-04a9030b171e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.296153 Jun 03 16:16:35.744446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 71/141] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:35 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:35.902354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:35.903820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:35.909747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.910189 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:35.910940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:35.911399 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.035361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.042635 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-30b83fab-7bff-44c6-99e7-5b269d326ad1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.144022 Jun 03 16:16:36.043482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 71/142] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:35 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:36.173709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:36.174345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:36.180345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.180799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.181557 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.182004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.197707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:36.198335 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:36.204792 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.205237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.205989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.206422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.314455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.321752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9b48bf2a-0f71-4e0b-8348-2b9a0e7e6431 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.151798 Jun 03 16:16:36.322307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 72/143] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:36 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:36.338628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.345999 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2d576ca4-2623-45e3-a7e7-4acbad5d685b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.152034 Jun 03 16:16:36.346551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 72/144] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:36 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:36.721950 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:36.722770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:36.728697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.729139 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.729897 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.730321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.761452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:36.762057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:36.768143 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.768583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.769338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:36.769767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:36.856135 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.863505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-96425cf7-a113-4b2e-9d47-60f1b4baa6cb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.145498 Jun 03 16:16:36.864073 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 73/145] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:36 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:36.898032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.906099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.907617 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:36.908714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ed1a4b50-3990-49ec-a458-f54219e3568e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.151091 Jun 03 16:16:36.909265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 73/146] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:36 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:37.060775 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:37.061487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:37.069792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.070650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.072632 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.073754 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.339370 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:37.340880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:37.347100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.347583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.348365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.348803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.646299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:37.656714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-863eae2d-053d-409e-968e-185611e29b16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.320559 Jun 03 16:16:37.657470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 74/147] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:37 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:37.663675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:37.665382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:37.672949 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.673782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.674798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.676075 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.754755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:37.763540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-68492fad-27d1-4493-9d91-0c6e18bbe1ce tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.707649 Jun 03 16:16:37.764505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 74/148] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:37 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:37.818615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:37.828146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2e588366-07fa-40dd-afac-4587e0427267 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.169392 Jun 03 16:16:37.828709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 75/149] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:37 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:37.880917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:37.881620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:37.888304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.888753 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.889513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.889948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.926827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:37.927541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:37.933545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.934494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:37.935266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:37.935728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.082740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:38.090776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:38.092311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:38.093427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ad44ea6e-f319-4705-8bc2-2e426bdb85f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.170550 Jun 03 16:16:38.093983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 76/150] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:37 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:38.387879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:38.396314 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-89249171-5727-4f45-8fcc-045ddec7bcab tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.519140 Jun 03 16:16:38.396895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 75/151] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:37 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:38.676332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:38.677066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:38.685264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:38.685724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.686499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:38.686939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.782737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:38.783412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:38.801839 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:38.805577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.806431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:38.807251 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.904333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:38.914790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-344ea7da-4e17-48b4-ad3f-8224ceab2d31 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.244026 Jun 03 16:16:38.925982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 77/152] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:38 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:38.931472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:38.936317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:38.949925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:38.952848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.953874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:38.954465 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:38.981464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:39.182908 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:39.193370 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e59c23f0-8a3c-4a93-892d-7c1f57749a55 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.266258 Jun 03 16:16:39.194129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 78/153] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:38 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:39.199945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:39.200551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:39.206487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.206939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:39.207747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.208175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:39.340052 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:39.348678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3e2c3004-4dcc-4d0f-8f81-ea93d3d7a52c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.571165 Jun 03 16:16:39.349776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 76/154] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:38 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:39.389260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:39.398771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:39.400850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:39.402176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-07078251-8f72-49e9-b3dd-8f6a3e2b0d8a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.206846 Jun 03 16:16:39.413020 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 79/155] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:39 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:39.416719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:39.417497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:39.425273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.425957 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:39.426960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.427555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:39.483177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-211dbba8-290b-4176-9c78-6f4c530f425c req-3067be82-9cd7-4bdc-92d5-baf0eea032bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:39.491968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-211dbba8-290b-4176-9c78-6f4c530f425c req-3067be82-9cd7-4bdc-92d5-baf0eea032bb service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.492415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-211dbba8-290b-4176-9c78-6f4c530f425c req-3067be82-9cd7-4bdc-92d5-baf0eea032bb service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:39.506505 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-211dbba8-290b-4176-9c78-6f4c530f425c req-3067be82-9cd7-4bdc-92d5-baf0eea032bb service nova] Creating event network-changed:e842e8b9-3bd1-4f5c-ad08-f8f45d991022 for instance a565de36-676c-4b81-ae49-3dfadf4dbd06 on hv-cinder-83699 Jun 03 16:16:39.512357 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-211dbba8-290b-4176-9c78-6f4c530f425c req-3067be82-9cd7-4bdc-92d5-baf0eea032bb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035947 Jun 03 16:16:39.513311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 80/156] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:16:39.712175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:39.720222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b231790b-83a9-4809-9993-e1ba28cbb77b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.309309 Jun 03 16:16:39.720796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 77/157] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:39 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:39.933553 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:39.934853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:39.942265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.942720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:39.943530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:39.943968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.071603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.079117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5cf30b58-8ff1-4eed-ab21-428a142fa6ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.150422 Jun 03 16:16:40.079714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 81/158] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:39 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:40.210065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:40.210667 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:40.217122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.217571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.218329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.218765 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.344437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.351836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-db4b69c9-0811-4173-be2c-4aabd076d4c8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.145655 Jun 03 16:16:40.352394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 78/159] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:40 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:40.365733 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:40.366350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:40.372326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.372780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.373547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.373989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.420147 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:40.420760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:40.426651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.427107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.427936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.428376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.503611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.511208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f61bf65d-e006-4dfc-afb6-f93070283c08 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.149272 Jun 03 16:16:40.512290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 82/160] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:40 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:40.558015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.565992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.567537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.568739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8e746240-b588-449b-8009-056af109670f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.152470 Jun 03 16:16:40.569302 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 79/161] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:40 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:40.737703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:40.738230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:40.744327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.744777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.745539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:40.746458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:40.872613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:40.880008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e3f86f8e-046b-41cd-9c4e-f6fc1f543774 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.146266 Jun 03 16:16:40.880564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 83/162] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:40 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:41.096721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:41.097328 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:41.103324 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.103774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.104540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.104952 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.367988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:41.368689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:41.375193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.375662 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.376422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.376853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.400291 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:41.408016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5c03d52f-d322-4a1a-9919-ac3e56878158 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.315069 Jun 03 16:16:41.408574 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 80/163] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:41 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:41.503790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:41.511083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1ae6b506-bb87-4400-a75a-8cc1eac3f0c0 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.146904 Jun 03 16:16:41.511694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 84/164] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:41 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:41.529090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:41.529728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:41.535748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.536191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.536945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.537375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.544723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-43018362-74e0-4991-80e2-ebc5c23aff37 req-c22e5b34-9394-45e6-8aeb-5677f7da0458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab42cfc-29a0-4c3f-b30b-e5902d661dd2", "tag": "d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6"}, {"name": "network-changed", "server_uuid": "4c90b829-8496-4298-b54d-fd9a976bbae3", "tag": "b13a12b7-9968-49f9-a695-b305c53c2ff7"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:41.553507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-43018362-74e0-4991-80e2-ebc5c23aff37 req-c22e5b34-9394-45e6-8aeb-5677f7da0458 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.553942 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-43018362-74e0-4991-80e2-ebc5c23aff37 req-c22e5b34-9394-45e6-8aeb-5677f7da0458 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.565996 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-43018362-74e0-4991-80e2-ebc5c23aff37 req-c22e5b34-9394-45e6-8aeb-5677f7da0458 service nova] Creating event network-changed:d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6 for instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 on hv-cinder-83699 Jun 03 16:16:41.566497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-43018362-74e0-4991-80e2-ebc5c23aff37 req-c22e5b34-9394-45e6-8aeb-5677f7da0458 service nova] Creating event network-changed:b13a12b7-9968-49f9-a695-b305c53c2ff7 for instance 4c90b829-8496-4298-b54d-fd9a976bbae3 on hv-cinder-83699 Jun 03 16:16:41.572769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-43018362-74e0-4991-80e2-ebc5c23aff37 req-c22e5b34-9394-45e6-8aeb-5677f7da0458 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032296 Jun 03 16:16:41.573356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 85/165] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:16:41.587136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:41.587857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:41.594467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.594913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.595702 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.596134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.619449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:41.665909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:41.674022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9d67c66d-3421-40df-87cd-b8407e363331 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.149824 Jun 03 16:16:41.674585 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 81/166] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:41 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:41.728122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:41.736581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:41.738076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:41.739173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1e70c8ec-3d60-450a-bef7-8c8595b72d5d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.156084 Jun 03 16:16:41.739746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 86/167] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:41 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:41.896754 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:41.897377 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:41.903949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.904404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:41.905174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:41.905611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.036632 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.044089 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-60afc0d4-557e-4256-b445-ebc683d2baf7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.151342 Jun 03 16:16:42.044646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 82/168] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:41 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:42.424302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:42.424914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:42.431176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.431657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.432428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.432869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.526629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:42.527358 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:42.533718 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.534143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.535177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.535705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.560873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.568268 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-918d4fab-a430-40e1-bc66-28288a88a304 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.147694 Jun 03 16:16:42.568833 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 87/169] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:42 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:42.660559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.667960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-dab2c547-2429-4a09-b7ef-f607ef1a0e3d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.145165 Jun 03 16:16:42.668528 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 83/170] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:42 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:42.690280 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:42.690885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:42.696819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.697267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.698026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.698463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.757111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:42.757664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:42.763802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.764248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.765011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:42.765443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:42.830541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.838090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f5bebd2b-2e7e-47a0-8bdd-6a6764c8290e tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.151540 Jun 03 16:16:42.838658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 88/171] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:42 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:42.895067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.903181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.905213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:42.906313 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-37be5789-53ca-4577-ad68-6d3c77719df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.153230 Jun 03 16:16:42.906862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 84/172] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:42 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:43.060553 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:43.061213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:43.067702 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.068202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.069116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.069619 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.195730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:43.203039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-65c72ade-73c5-45af-9136-1d2d68ceedd7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.146354 Jun 03 16:16:43.203620 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 89/173] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:43 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:43.585780 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:43.586730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:43.594658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.595239 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.596088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.596553 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.685967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:43.686563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:43.693341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.696221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.697137 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.697581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.823600 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:43.826342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:43.827257 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:43.832746 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bf856e84-3aea-4a5a-8697-579fd84291e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.251709 Jun 03 16:16:43.833331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 85/174] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:43 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:43.834875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-67c1dfbd-010d-4709-8c26-2408fdd223b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.153451 Jun 03 16:16:43.835456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 90/175] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:43 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:43.853652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:43.854199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:43.860067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.860510 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.861267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.861701 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.924755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:43.925369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:43.931586 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.932039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.932894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:43.933338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:43.994788 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:44.002804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-04317f8e-0da5-41d8-8f02-6247b4488fd2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.152860 Jun 03 16:16:44.003442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 86/176] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:43 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:44.067669 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:44.077483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:44.078981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:44.080107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d1fbf72c-e0b4-4c1d-be1b-a823b61805c4 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.160265 Jun 03 16:16:44.080664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 91/177] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:43 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:44.219737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:44.220350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:44.226306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:44.226749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:44.227540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:44.227973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:44.358847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:44.366315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c0382fe3-362f-46ce-b14d-167744aa4dbe tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.150427 Jun 03 16:16:44.366866 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 87/178] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:44 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:44.849514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:44.850156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:44.851071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:44.851714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:44.856446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:44.857391 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:44.858047 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:44.858284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:44.858484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:44.858876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:44.859238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:44.859705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:44.990734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:44.991432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:45.004621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-783544fd-fa5d-4bcd-a84c-e7b8f2449428 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.157237 Jun 03 16:16:45.004774 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4164165e-9d95-4b6b-af67-d5498aa5f868 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.158890 Jun 03 16:16:45.005483 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 88/179] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:44 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:45.005716 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 92/180] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:44 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:45.020172 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:45.020975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:45.029129 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:45.029750 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:45.030526 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:45.030965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:45.097299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:45.098263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:45.105214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:45.105796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:45.106752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:45.107935 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:45.179437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:45.187668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0ffbf760-008f-4e67-8cbd-f9faa169ebbb tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.171206 Jun 03 16:16:45.188223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 89/181] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:45 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:45.244841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:45.253156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:45.254587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:45.255760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-17508cd7-8697-4c89-8bfc-1cccc5b684a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.162739 Jun 03 16:16:45.256348 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 93/182] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:45 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:45.382865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:45.383611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:45.389835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:45.389835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:45.390689 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:45.391121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:45.517779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:45.525698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8cf7b358-d5b0-4aec-96cd-b05f788ce00b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.146649 Jun 03 16:16:45.526258 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 90/183] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:45 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:46.022328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:46.023989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:46.025182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:46.025867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:46.030634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.031059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.032488 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.032850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.033337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.033592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.034665 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.035100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.173527 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.178262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.183233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-aaf81ab5-ca57-4882-a7e3-de04e8f55d6a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.161413 Jun 03 16:16:46.185442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 91/184] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:46 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:46.191719 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-51fb6dff-d7cb-4cae-9f1c-d256ad0d9550 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.172738 Jun 03 16:16:46.203107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 94/185] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:46 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:46.205374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:46.206182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:46.212330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.212870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.213647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.214085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.273842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:46.275328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:46.287350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.288240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.289088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.289707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.361728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.369792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-702a18c4-8d0f-4266-b935-c48371a08b0c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.169492 Jun 03 16:16:46.370593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 92/186] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:46 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:46.469821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.479414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.481480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.483664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5c8a92a1-48ab-4c39-b626-a7586619c360 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.214185 Jun 03 16:16:46.494552 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 95/187] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:46 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:46.547844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:46.548460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:46.554289 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.554738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.555535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:46.555974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:46.729414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:46.737451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-99e65bd6-3a9f-410c-a5dc-6743c0b1a395 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.193927 Jun 03 16:16:46.738235 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 93/188] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:46 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:47.201889 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:47.202494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:47.208582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.209253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.210029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.210138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:47.210539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.210781 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:47.214738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:47.217889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.218424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.219200 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.219664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.356656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.364478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.368409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8977b9f3-cec5-433d-858c-5658861d969f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.162188 Jun 03 16:16:47.368981 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 94/189] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:47 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:47.374391 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-532cbc28-80d4-4d45-8acf-480bdb0f7c89 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.176845 Jun 03 16:16:47.374993 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 96/190] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:47 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:47.389570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:47.390257 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:47.397800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.397800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.397800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.398074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.501826 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:47.502463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:47.508866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.509241 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.510237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.510446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.536074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.546656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-76201fe8-ec1d-4b65-9a42-4212ad7303e6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.161101 Jun 03 16:16:47.547321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 95/191] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:47 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:47.647639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.656374 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.657904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.659031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dc6989d1-2627-454f-ac08-1bf75588072a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.161639 Jun 03 16:16:47.659627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 97/192] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:47 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:47.759447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:47.759926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:47.766322 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.766764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.767541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:47.767974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:47.900090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:47.907842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1e608deb-aba1-4f88-b3fa-d80cb44d2af4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.152197 Jun 03 16:16:47.908306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 96/193] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:47 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:48.385820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:48.386547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:48.392578 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:48.393074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.393591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.394206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:48.394434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.394938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.400749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.401569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.402894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.404272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.551646 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:48.561861 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-86ecf951-c296-433b-b85b-25d182c8405e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.180950 Jun 03 16:16:48.562604 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 98/194] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:48 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:48.567978 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:48.568691 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:48.577350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.578152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.579324 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.579982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.605042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:48.621126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ddd270c5-6879-42f0-8228-7c81ef9f28f6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.233185 Jun 03 16:16:48.623334 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 97/195] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:48 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:48.676982 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:48.677686 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:48.683669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.684111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.684903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.685333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.712021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:48.720240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6bdcebef-a2c9-4102-9c39-b84db8b23f7c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.156597 Jun 03 16:16:48.720842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 99/196] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:48 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:48.816655 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:48.824516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:48.826560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:48.827722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3a25b398-1013-4654-ab1b-73c199c99c8d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.154479 Jun 03 16:16:48.828310 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 98/197] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:48 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:48.924292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:48.924917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:48.930962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.931462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:48.932234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:48.932676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.058512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.067210 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-954d545c-caa3-4966-817c-daeee7beea88 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.146586 Jun 03 16:16:49.067803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 100/198] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:48 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:49.577966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:49.578577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:49.584779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.585232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.586095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.586532 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.637742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:49.638419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:49.644863 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.645320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.646100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.646545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.722949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.730444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d325b8b7-b1b5-4044-aaac-8d2a4eed737e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.156406 Jun 03 16:16:49.731003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 99/199] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:49 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:49.736579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:49.737192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:49.743392 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.743849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.744619 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.745059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.779749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.787135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-880c0c90-dec1-48a2-bd5e-10f5765485e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.153140 Jun 03 16:16:49.787738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 101/200] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:49 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:49.845489 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:49.846093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:49.852015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.852464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.853221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:49.853654 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:49.871961 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.879397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-701a7b02-1dff-4674-b4fb-c61e3c411918 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.146318 Jun 03 16:16:49.879966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 100/201] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:49 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:49.978828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.987341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.988856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:49.989952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9afd90ae-5f45-4f01-a791-5637b47b853b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.148780 Jun 03 16:16:49.990499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 102/202] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:49 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:50.085185 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:50.085715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:50.092235 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.092679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.093427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.093863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.220997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:50.228428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-19389e97-a077-496b-afaa-5f4888bda2dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.147177 Jun 03 16:16:50.228992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 101/203] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:50 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:50.747989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:50.748591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:50.754713 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.755159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.755977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.756411 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.804713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:50.805330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:50.812085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.812542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.813316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.813760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.828385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:50.887581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:50.895271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-be3d75b0-8f77-4a39-823a-703c4e3ec3bd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.151535 Jun 03 16:16:50.895855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 103/204] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:50 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:50.900368 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:50.901083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:50.907207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.907787 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.908556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:50.908989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:50.945378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:50.953305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a27ddf9c-d82f-4a84-b6bd-3f0d2b301723 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.152683 Jun 03 16:16:50.953925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 102/205] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:50 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:51.007549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:51.008182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:51.014059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.014506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.015273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.015760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.042240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:51.050213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-88c92b8e-0c6e-43ea-9608-40b4bdf69095 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.153384 Jun 03 16:16:51.050773 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 104/206] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:50 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:51.146611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:51.155123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:51.156685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:51.157785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-965c01eb-40e7-4fd0-b8fd-006e4d82aacf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.154164 Jun 03 16:16:51.158344 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 103/207] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:51 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:51.245204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:51.245808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:51.251928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.252373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.253516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.253605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.375777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:51.382988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-29345b05-37a3-4779-89fa-fce12112503c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.141567 Jun 03 16:16:51.383575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 105/208] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:51 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:51.912011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:51.912621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:51.918536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.919015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.919802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.920234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.970051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:51.970663 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:51.976833 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.977291 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:51.978529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:51.978529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.060411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.070954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d72cc9cf-8adc-4eb5-bebe-04375f6f9ca7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.162333 Jun 03 16:16:52.071763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 104/209] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:51 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:52.077251 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:52.078035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:52.084578 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:52.085033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.085852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:52.086291 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.125232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.133620 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-81c6a1bc-63a0-474c-a349-b32011d8eb97 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.167288 Jun 03 16:16:52.134205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 106/210] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:51 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:52.175559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:52.176647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:52.182539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:52.183000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.183816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:52.184257 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.221639 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.232080 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a4e13b52-4cc5-41f6-bb1a-fe7e6d3e2257 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.159037 Jun 03 16:16:52.232669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 105/211] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:52 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:52.313893 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.321769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.323284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.324409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-426e8707-5bc4-48b3-bf69-4841e018ba32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.152797 Jun 03 16:16:52.324962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 107/212] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:52 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:52.399358 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:52.399977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:52.406151 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:52.406603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.407397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:52.407839 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:52.530703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:52.538075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4d217dd6-0780-41c2-9008-73ad0e989f87 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.142498 Jun 03 16:16:52.538643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 106/213] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:52 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:53.088477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:53.089095 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:53.092066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:53.096144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.096599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.097370 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.097812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.149962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:53.150579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:53.156932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.157381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.158158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.158999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.234063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.241607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-36647a47-22d9-484c-bcac-a996d81c7000 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.156997 Jun 03 16:16:53.242176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 108/214] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:53 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:53.250281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:53.250281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:53.255936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.256390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.257163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.257648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.288817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.297289 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cac8436d-6936-4f7f-b710-9e4e2b20b0ec tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.151174 Jun 03 16:16:53.297851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 107/215] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:53 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:53.341797 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:53.342398 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:53.348322 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.348767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.349519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.349948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.383802 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.391472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8273cc72-d21a-4d87-af01-0863fe27907a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.146597 Jun 03 16:16:53.392116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 109/216] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:53 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:53.480992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.490132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.491710 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.492864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f8c157e1-e142-43e8-9108-f5ea83fef3f8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.154845 Jun 03 16:16:53.493432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 108/217] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:53 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:53.555348 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:53.555868 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:53.561847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.562290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.563039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:53.563511 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:53.691954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:53.699280 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-922a2abd-9cfa-4fe2-9e48-6c5ff8f822d5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.147877 Jun 03 16:16:53.699977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 110/218] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:53 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:54.259617 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:54.260236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:54.266947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.267421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.268177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.268611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.314378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:54.315076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:54.321077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.321596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.322423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.322937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.394543 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.403242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-21eb3d86-0ccc-4aed-95bb-8aa02edad183 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.146220 Jun 03 16:16:54.403242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 109/219] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:54 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:54.409393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:54.410015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:54.416683 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.417136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.417906 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.418354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.449383 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.457727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4e18f6ee-0265-40f0-b771-62b1e445e5e4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.147635 Jun 03 16:16:54.458298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 111/220] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:54 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:54.509898 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:54.510423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:54.517327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.517862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.518737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.519258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.550381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.558265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-046b5dcc-8e77-431a-b918-ee92c6d1424c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1315 microversion: 2.1 time: 0.152406 Jun 03 16:16:54.558820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 110/221] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:54 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:54.645778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.649234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:16:54.654699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.656229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.657329 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-23dbc491-148d-4f8c-80b5-f0c214c57c6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.151350 Jun 03 16:16:54.657887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 112/222] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:54 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:54.716087 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:54.716735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:54.722920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.723512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.724494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:54.725103 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:54.877306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:54.885021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bac4a26a-9c37-4383-a1f9-b4ddc662dafa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.172629 Jun 03 16:16:54.885577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 111/223] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:54 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:55.418114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:55.418718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:55.424712 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.425166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.425927 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.426359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.475019 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:55.475728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:55.481815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.482426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.483193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.483940 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.565822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:55.573432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dfdb5583-164d-486a-b5c2-d207fb2dcd41 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.159275 Jun 03 16:16:55.574002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 113/224] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:55 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:55.578977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:55.579616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:55.585609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.586099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.586889 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.587355 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.703230 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:55.711810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8e8cfde1-b4b0-4674-9f51-0dc429c98cbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.241630 Jun 03 16:16:55.712378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 112/225] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:55 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:55.717179 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:55.717886 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:55.721283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:55.723768 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.724236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.725012 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.725479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.731006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ae7beaf9-51b4-4c95-a10e-3dff075ae45c tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1502 microversion: 2.1 time: 0.156017 Jun 03 16:16:55.731619 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 114/226] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:55 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:55.867479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:55.876007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:55.877852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:55.878897 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-aa07a363-6ed1-4515-85c5-310d45e7cdd5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.165613 Jun 03 16:16:55.879661 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 113/227] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:55 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:55.902085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:55.902956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:55.909839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.910305 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:55.911269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:55.911739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.092035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:56.116093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e58559c2-4752-4c0e-89db-eec621c28e24 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.217882 Jun 03 16:16:56.116678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 115/228] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:55 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:56.589695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:56.590375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:56.596640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.597098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.597945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.598388 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.729388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:56.730067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:56.731675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:56.736322 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.736779 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.737553 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.738168 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.739558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a08a93fb-1768-4b38-bb79-3a4aec0363fd tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.153574 Jun 03 16:16:56.740129 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 114/229] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:56 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:56.871564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:56.877288 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-89226b64-4783-444c-86b9-218059c48041 req-a7193887-2e16-44fe-9652-d9e9afb13eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03", "name": "network-vif-plugged", "status": "completed", "tag": "db97c3da-b633-48cb-8479-c740ca53cd00"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:56.879944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4478b846-b6b2-441f-a53e-e1707c77dcb7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.154837 Jun 03 16:16:56.880508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 116/230] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:56 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:56.886283 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-89226b64-4783-444c-86b9-218059c48041 req-a7193887-2e16-44fe-9652-d9e9afb13eb9 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.886797 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-89226b64-4783-444c-86b9-218059c48041 req-a7193887-2e16-44fe-9652-d9e9afb13eb9 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.898822 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-89226b64-4783-444c-86b9-218059c48041 req-a7193887-2e16-44fe-9652-d9e9afb13eb9 service nova] Creating event network-vif-plugged:db97c3da-b633-48cb-8479-c740ca53cd00 for instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 on hv-cinder-83699 Jun 03 16:16:56.899289 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:56.899916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:56.904169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-89226b64-4783-444c-86b9-218059c48041 req-a7193887-2e16-44fe-9652-d9e9afb13eb9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030512 Jun 03 16:16:56.904754 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 115/231] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:16:56.906602 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.907053 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:56.907868 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:56.908306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.033756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:57.042286 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:57.043858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:57.045483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f4653b4c-aed8-4c89-9291-15c214fd8276 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.150158 Jun 03 16:16:57.046064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 117/232] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:56 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:16:57.134232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:57.134941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:57.142002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:57.142458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.143238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:57.143709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.275447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:57.283552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3871198e-be3d-4aee-9c2a-1ea56b46472b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.153442 Jun 03 16:16:57.284112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 116/233] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:57 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:57.756865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:57.757482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:57.764066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:57.764525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.765291 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:57.765733 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.897658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:57.898884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:57.905798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:57.907813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:57.908329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.909437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:57.910170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:57.914418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0c15337a-a8cd-440a-b896-0f63f47c6549 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.161333 Jun 03 16:16:57.915155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 118/234] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:57 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:58.042724 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:58.051716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-70c1c505-7406-4e86-a9e2-12ec31513417 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.158460 Jun 03 16:16:58.052275 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 117/235] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:57 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:58.066145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:58.066786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:58.072844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.073291 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.074143 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.074554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.211335 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:58.220265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:58.221357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abde8610-ab5d-4e15-978c-b571261c3f2c"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:16:58.222252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:58.222569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:58.224328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0ba121a2-d18f-4e8c-9417-f6c75ddb249e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.162052 Jun 03 16:16:58.228759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.229390 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.230307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.230900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.235333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 119/236] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:58 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:58.301188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:58.301913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:58.308239 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.308782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.309653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.310731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.445818 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:58.454032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-62e4a1ff-7f2f-4a8c-ad7f-b82da68f3f91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.156808 Jun 03 16:16:58.454599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 120/237] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:58 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:16:58.932930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:58.933694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:58.940911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.941356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:58.942284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:58.942718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.081957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:59.090270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a57f2b38-4c6e-4824-a055-d07baef9df22 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.161870 Jun 03 16:16:59.091063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 121/238] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:58 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:59.099704 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:59.100378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:59.106388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:59.107460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.108293 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:59.108845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.249666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:59.257700 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2d21f6cd-11ce-45b2-96ef-ce05c4b8f103 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.165659 Jun 03 16:16:59.258259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 122/239] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:59 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:16:59.262655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:59.263309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:59.270214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:59.270709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.271554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:59.272105 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.401052 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:59.409770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:59.411264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:59.412380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fa52c8e5-b357-4b9d-9d2f-580b845089c1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.153227 Jun 03 16:16:59.412929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 123/240] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:16:59 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:16:59.470399 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:16:59.471008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:16:59.476945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:59.477398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.478155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:16:59.478598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:16:59.668035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:16:59.678933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ac5e56e8-3e66-4141-a578-f41dd4d15114 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.212772 Jun 03 16:16:59.680089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 124/241] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:16:59 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:00.108525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:00.109369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:00.115552 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.116165 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.117082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.117515 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.369152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:00.377863 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-af306147-fe49-443b-abf6-21cd8bf48c74 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.274137 Jun 03 16:17:00.378459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 125/242] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:00 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:00.391721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:00.392753 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:00.399755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.400409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.401173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.402227 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.640567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:00.656174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c17a2fe1-01a1-4ce4-9c05-f19297e13249 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.276517 Jun 03 16:17:00.658231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 126/243] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:00 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:00.678764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:00.680694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:00.695318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.695675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.696819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.698419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.871448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:00.920096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:00.926269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-23ff2190-cc05-4bec-8f60-0ef09771dfa1 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "POST /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.708799 Jun 03 16:17:00.927249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 118/244] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:16:58 2022] POST /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7/os-volume_attachments => generated 194 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:17:00.958737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:00.963498 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:00.966390 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:00.966982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:00.969022 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3aba5c4d-d813-400e-b822-1e7acb0730fb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.306036 Jun 03 16:17:00.972728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 127/245] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:00 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:00.981530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:00.983999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.984450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:00.985337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:00.985788 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:01.394496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:01.395181 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:01.402846 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:01.404156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:01.405163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:01.405791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:01.511443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:01.522336 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-56c59e0e-667c-411c-8a62-2a7c43aeb050 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.591810 Jun 03 16:17:01.523577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 119/246] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:00 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:01.592608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:01.606024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-18a5ce3b-c1d4-4373-b72e-afa5fcce994c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.211844 Jun 03 16:17:01.607900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 128/247] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:01 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:01.675492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:01.676037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:01.685134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:01.685134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:01.685892 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:01.686356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:01.853356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:01.861234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e73840e6-cc63-48bc-8824-6b46035362ad tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.190012 Jun 03 16:17:01.861794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 120/248] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:01 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:01.990733 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:01.991372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:01.997247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:01.997754 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:01.998653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:01.998973 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:02.017313 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:02.139464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:02.147562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:02.149076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:02.150214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d0105480-a26f-4e0c-b360-86a167caccc8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.164301 Jun 03 16:17:02.150773 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 129/249] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:01 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:02.540823 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:02.541432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:02.547947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:02.548470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:02.549262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:02.549692 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:02.625126 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:02.625822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:02.637541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:02.638632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:02.639558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:02.640064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:02.680530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:02.689122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-257c5f7d-d6d4-4fb3-8d76-692f1b443e1d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.152064 Jun 03 16:17:02.689945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 121/250] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:02 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:02.773916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:02.782613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-013c6f52-b81e-4b94-a6b7-b42a54fe7b72 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.162390 Jun 03 16:17:02.783239 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 130/251] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:02 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:02.878170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:02.879177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:02.885372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:02.885889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:02.886729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:02.887232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.020798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:03.028762 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b1065573-9c85-4c12-b57b-091d7a7b4bd4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.154315 Jun 03 16:17:03.029654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 122/252] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:02 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:03.168965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:03.170216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:03.176610 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:03.177292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.178156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:03.178739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.312468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:03.320485 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:03.321997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:03.323146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-320e9c3b-4177-49fb-9271-d93cf545b0a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.158659 Jun 03 16:17:03.323684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 131/253] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:03 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:03.706704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:03.707659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:03.719371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:03.719906 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.720776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:03.721284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.800685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:03.801297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:03.807513 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:03.811186 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.812014 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:03.812457 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:03.860049 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:03.869055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-067677fc-0ae1-45eb-8d84-0940dcd88888 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.166477 Jun 03 16:17:03.870179 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 123/254] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:03 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:03.963901 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:03.971921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-805c9bfb-d8cb-49ae-9616-3fed2ce7cdf1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.175312 Jun 03 16:17:03.972836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 132/255] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:03 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:04.046448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:04.047063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:04.053430 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.053941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.054787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.055458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.199489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:04.208777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5c251246-5e36-4e7a-82c9-18d38b5f82e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.166819 Jun 03 16:17:04.209591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 124/256] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:04 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:04.341367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:04.341981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:04.347936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.348384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.349143 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.349582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.472474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:04.480577 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:04.482650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:04.483792 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d737de14-7da4-4a71-93ed-9d24c75e64eb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.146398 Jun 03 16:17:04.484351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 133/257] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:04 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:04.885614 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:04.886223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:04.892554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.892997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.893747 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.894178 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.989031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:04.990015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:04.995918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.996455 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:04.997302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:04.997821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:05.021586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:05.029785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-68c4d0d6-8838-4594-8a2f-df7718a9528a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.147914 Jun 03 16:17:05.030343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 125/258] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:04 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:05.125354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:05.132724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9921080c-0fbf-4195-83a8-2624924e220a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.147539 Jun 03 16:17:05.133293 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 134/259] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:04 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:05.225524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:05.226132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:05.232576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:05.233021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:05.233785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:05.234217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:05.367535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:05.375490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-90fa0887-48f6-40ad-b675-b863b773aa15 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.153659 Jun 03 16:17:05.375992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 126/260] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:05 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:05.503234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:05.504042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:05.510611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:05.511153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:05.512008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:05.512426 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:05.669646 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:05.677442 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:05.678938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:05.680048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d3390544-6980-401f-aa11-a0f7d738559c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.181789 Jun 03 16:17:05.680597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 135/261] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:05 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:06.046237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:06.046958 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:06.053468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.053920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.054677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.055113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.149764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:06.150460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:06.157276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.157737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.158508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.158972 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.188956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:06.196412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a91f8600-3568-416c-8a55-edea75c4c35f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.154470 Jun 03 16:17:06.197010 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 127/262] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:06 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:06.286939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:06.295286 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2b97c30b-cb5e-4793-ab31-ad074f549fdb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.149304 Jun 03 16:17:06.295861 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 136/263] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:06 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:06.392003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:06.392615 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:06.398713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.399170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.399974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.400410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.524409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:06.532668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fb1e7711-81ce-446a-b123-c5ab57606517 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.144400 Jun 03 16:17:06.533238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 128/264] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:06 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:06.697736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:06.698343 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:06.704905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.705343 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.706105 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:06.706544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:06.828633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:06.836415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:06.837969 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:06.839090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-04edef4e-9258-457e-8934-e73969020163 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.145217 Jun 03 16:17:06.839981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 137/265] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:06 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:07.212947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:07.213567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:07.220005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.220458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.221221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.221670 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.313828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:07.314453 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:07.320769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.321225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.322006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.322446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.352143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:07.381477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b6d2610c-c045-4b27-82fc-95a21cae15fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.172192 Jun 03 16:17:07.382052 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 129/266] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:07 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:07.485359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:07.493307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c71e76e8-6208-4cee-a119-3801be406e17 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.185020 Jun 03 16:17:07.493894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 138/267] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:07 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:07.549140 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:07.549763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:07.555697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.556215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.557060 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.557561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.579815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-d569b3e5-8f29-44d3-a757-93abc73e7f4e req-dcb1b500-1473-4b9b-b2ca-1ebcb2066f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de1f638-4fee-41e2-bd50-b802f8494fad", "name": "network-vif-plugged", "status": "completed", "tag": "fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:07.588460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-d569b3e5-8f29-44d3-a757-93abc73e7f4e req-dcb1b500-1473-4b9b-b2ca-1ebcb2066f23 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.589009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-d569b3e5-8f29-44d3-a757-93abc73e7f4e req-dcb1b500-1473-4b9b-b2ca-1ebcb2066f23 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.600781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-d569b3e5-8f29-44d3-a757-93abc73e7f4e req-dcb1b500-1473-4b9b-b2ca-1ebcb2066f23 service nova] Creating event network-vif-plugged:fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c for instance 2de1f638-4fee-41e2-bd50-b802f8494fad on hv-cinder-83699 Jun 03 16:17:07.605907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-d569b3e5-8f29-44d3-a757-93abc73e7f4e req-dcb1b500-1473-4b9b-b2ca-1ebcb2066f23 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030293 Jun 03 16:17:07.607191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 139/268] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:17:07.689373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:07.696750 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6248470d-067a-48e0-ad30-1c3b318223ca tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.151604 Jun 03 16:17:07.697312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 130/269] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:07 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:07.857737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:07.858361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:07.864630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.865064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.865828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:07.866268 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:07.989417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:07.998010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:07.999539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:08.000660 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5a033bdd-57a4-41c6-b476-63402002fb56 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.147898 Jun 03 16:17:08.001217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 140/270] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:07 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:08.397705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:08.398319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:08.405571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:08.406021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:08.406784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:08.407224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:08.509932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:08.510470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:08.517010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:08.517461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:08.518230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:08.518671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:08.533014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:08.540383 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1c061076-b326-4b1a-b138-5ff645770c13 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.146389 Jun 03 16:17:08.540948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 131/271] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:08 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:08.644122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:08.651585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f23cf6c4-db1a-428d-81c2-22bd3aa81b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.145440 Jun 03 16:17:08.652432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 141/272] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:08 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:08.713569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:08.714180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:08.720783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:08.721230 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:08.721996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:08.722430 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:08.848241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:08.855554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8db17f69-813d-43d7-9979-26cb8cf58c02 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.145789 Jun 03 16:17:08.856109 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 132/273] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:08 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:09.017983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:09.018594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:09.027776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.028547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.029944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.030681 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.169911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:09.178159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:09.179744 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:09.180846 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d701e789-7944-4733-8c76-8c585f5cafea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.166780 Jun 03 16:17:09.181482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 142/274] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:09 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:09.557859 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:09.558565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:09.564891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.565342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.566096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.566561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.673776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:09.674803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:09.684151 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.684891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.686281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.686916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.702554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:09.710436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8f1a5a9f-afc6-4835-971b-10092954ce56 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.156449 Jun 03 16:17:09.710999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 133/275] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:09 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:09.834913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:09.843436 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-069b89b3-0500-4f69-9d22-7e975c1fbdab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.176725 Jun 03 16:17:09.844112 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 143/276] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:09 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:09.875515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:09.875515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:09.879422 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.880067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:09.880832 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:09.881262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.202874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:10.203964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:10.212418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:10.213149 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.214048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:10.215207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.304703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:10.313476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9dac8d65-eb12-4391-aecd-f204fa9c9941 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.445148 Jun 03 16:17:10.314220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 134/277] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:09 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:10.359591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:10.367684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:10.369269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:10.370366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-62a89cab-47a3-422c-afd1-1230f6987766 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.173749 Jun 03 16:17:10.370924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 144/278] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:10 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:10.727817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:10.728435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:10.735657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:10.736111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.736890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:10.737329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.741246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:10.863178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:10.863914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:10.871568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:10.871930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.872891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:10.873509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:10.880335 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:10.889624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b93dc3b1-1ef4-4968-8b3a-3dbd7dc7193a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.165584 Jun 03 16:17:10.890199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 135/279] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:10 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:11.189275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:11.197026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-be18607e-3b4e-46b3-8443-058112dff6a3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.340303 Jun 03 16:17:11.197845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 145/280] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:10 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:11.331505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:11.332883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:11.345399 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:11.346379 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:11.347469 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:11.347985 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:11.390479 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:11.391284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:11.399110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:11.399110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:11.399693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:11.400129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:11.517310 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:11.529383 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6ad7d92c-e443-4371-a1e1-4289bb1defde tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.202384 Jun 03 16:17:11.540226 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 136/281] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:11 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:11.542936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:11.547029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:11.553039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:11.554840 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:11.556146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6c5e2083-08c1-4988-adec-98356d72e1ae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.171571 Jun 03 16:17:11.566902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 146/282] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:11 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:11.906304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:11.906979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:11.913381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:11.913824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:11.914581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:11.915009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.061099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:12.069736 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8c41feec-6ed4-4ac8-98b0-0f92aed4bd4b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.167735 Jun 03 16:17:12.070369 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 137/283] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:11 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:12.213899 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:12.215450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:12.224423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:12.224873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.225825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:12.226261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.372671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:12.389075 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3ccefecd-e3eb-4084-83a7-0b91742d6063 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.170651 Jun 03 16:17:12.389075 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 147/284] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:12 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:12.550903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:12.551709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:12.559836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:12.560499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.561447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:12.561886 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.576678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:12.577886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:12.588481 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:12.589243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.591492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:12.592139 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:12.759377 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:12.769032 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d2e6087a-e69d-4107-8712-8a6ac1c14df0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.226661 Jun 03 16:17:12.769622 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 138/285] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:12 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:12.789825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:12.798823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:12.800444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:12.801678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d9ef2b14-68dc-49a7-acb3-c4f19bab0fc5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.231455 Jun 03 16:17:12.802229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 148/286] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:12 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:13.087555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:13.088690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:13.097293 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.097735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.098559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.099130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.273839 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:13.282674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-adbf877e-f6b6-4bbf-a428-94be83d7ca22 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.199351 Jun 03 16:17:13.283199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 139/287] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:13 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:13.396571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:13.397182 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:13.403979 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.404524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.405556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.406226 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.738847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:13.748798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-40144433-9f7c-4154-964d-b4e1e85d20c7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.355686 Jun 03 16:17:13.753081 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 149/288] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:13 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:13.786357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:13.787040 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:13.808886 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.810665 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.811871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.812311 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.821911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:13.822671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:13.832618 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.835205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.838229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:13.838777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:13.978153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:13.988270 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6f4807de-111c-4b1d-b911-75731171dfbe tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.205214 Jun 03 16:17:13.993423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 140/289] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:13 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:14.029469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:14.038981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:14.041041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:14.042734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-61b453e6-b798-4c28-9f1d-4da7820bc06c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.225633 Jun 03 16:17:14.043629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 150/290] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:13 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:14.058713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-40b238bc-5d46-4b1b-998b-0ce4dcad8a3c req-d49dda6c-7432-4eac-b116-904c4c9f497e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c90b829-8496-4298-b54d-fd9a976bbae3", "name": "network-vif-plugged", "status": "completed", "tag": "b13a12b7-9968-49f9-a695-b305c53c2ff7"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:14.070312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-40b238bc-5d46-4b1b-998b-0ce4dcad8a3c req-d49dda6c-7432-4eac-b116-904c4c9f497e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:14.070884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-40b238bc-5d46-4b1b-998b-0ce4dcad8a3c req-d49dda6c-7432-4eac-b116-904c4c9f497e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:14.085241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-40b238bc-5d46-4b1b-998b-0ce4dcad8a3c req-d49dda6c-7432-4eac-b116-904c4c9f497e service nova] Creating event network-vif-plugged:b13a12b7-9968-49f9-a695-b305c53c2ff7 for instance 4c90b829-8496-4298-b54d-fd9a976bbae3 on hv-cinder-83699 Jun 03 16:17:14.091687 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-40b238bc-5d46-4b1b-998b-0ce4dcad8a3c req-d49dda6c-7432-4eac-b116-904c4c9f497e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Jun 03 16:17:14.092935 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 141/291] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:17:14.300321 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:14.301034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:14.308656 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:14.309217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:14.310850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:14.311380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:14.460911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:14.471637 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1b35be20-d443-4c94-a1e6-373f400d028a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.175020 Jun 03 16:17:14.472217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 151/292] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:14 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:14.767699 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:14.768465 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:14.774960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:14.775447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:14.776222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:14.776663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:14.951854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:14.959874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a847ed00-57ac-4e28-bd8c-8b9aeec0be81 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.197360 Jun 03 16:17:14.961458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 142/293] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:14 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:15.005875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:15.006401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:15.012336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.012815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.013582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.014013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.061873 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:15.062672 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:15.069554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.070000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.070841 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.071271 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.203496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:15.207546 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:15.212972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:15.214809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:15.216578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9a7b50c6-6a62-40dc-b65e-e6daf6f5081d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.213843 Jun 03 16:17:15.216968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fe184f3d-fcb5-4785-8046-bc24f025567b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.159430 Jun 03 16:17:15.226244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 152/294] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:15 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:15.228072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 143/295] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:15 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:15.489148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:15.489963 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:15.496112 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.496657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.497427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.497862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.644238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:15.652955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-48d96782-1563-45a0-9600-095e4edba7a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.167777 Jun 03 16:17:15.654254 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 153/296] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:15 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:15.977020 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:15.977745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:15.984377 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.984829 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:15.985598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:15.986034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.116817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:16.124678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a47db2c0-e4e1-4048-8ac8-4091cc58e209 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.151452 Jun 03 16:17:16.125231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 144/297] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:15 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:16.234472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:16.235084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:16.237967 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:16.239247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:16.241320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:16.241957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.242720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:16.243322 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.245822 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:16.246392 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.247980 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:16.248430 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.381172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:16.388889 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3b62dded-e1e9-4306-83bc-578622376f3e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.159507 Jun 03 16:17:16.389670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 154/298] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:16 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:16.420505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:16.428517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:16.430066 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:16.431176 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-aff79c2d-e452-4a3e-9569-5b3ffed8526b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.197530 Jun 03 16:17:16.431827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 145/299] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:16 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:16.669903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:16.670430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:16.676419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:16.676871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.677645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:16.678084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:16.822343 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:16.831193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d771aca4-1463-4c7f-83cd-1da6588a3425 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.165065 Jun 03 16:17:16.831751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 155/300] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:16 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:17.141525 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:17.142178 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:17.149255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.149817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.150594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.151030 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.290121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:17.298652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-af1e6987-0591-4cbe-a578-af7d5f01144d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.161669 Jun 03 16:17:17.299216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 146/301] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:17 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:17.406311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:17.406897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:17.413004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.413455 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.414226 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.414665 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.449438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:17.450604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:17.456720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.457258 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.457941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.458378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.555326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:17.564676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9648cba3-84dc-4d27-a057-10da2073455e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.162282 Jun 03 16:17:17.565266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 156/302] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:17 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:17.600011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:17.608682 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:17.610186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:17.611427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7795fbac-1831-4740-95a0-11addb0bf63c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.165747 Jun 03 16:17:17.611982 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 147/303] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:17 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:17.853210 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:17.853828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:17.859857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.860311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:17.861086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:17.861524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.043250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:18.051503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-976f4934-060a-4f29-acd5-0b62d1a890b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.202316 Jun 03 16:17:18.052065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 157/304] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:17 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:18.315442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:18.316056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:18.322864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:18.323337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.324112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:18.324548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.455388 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:18.464508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ff99c56e-bfdd-4e63-8420-043b8b282e5d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.152873 Jun 03 16:17:18.465616 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 148/305] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:18 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:18.581448 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:18.582058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:18.584944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:18.589700 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:18.590145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.591038 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:18.591497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.630965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:18.631849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:18.638853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:18.639327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.640099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:18.641719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:18.743319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:18.752149 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8e499c01-e141-4475-93e2-20bc062adc39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.174610 Jun 03 16:17:18.752718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 158/306] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:18 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:18.811502 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:18.819268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:18.820795 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:18.821884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b5d966b6-c3a9-4faf-8740-134e8f5fea7b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.196119 Jun 03 16:17:18.822431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 149/307] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:18 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:19.067860 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:19.069374 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:19.079018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.079807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.080765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.081252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.219668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:19.228612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ecf5cb9f-ca4c-4215-8143-866f865c0226 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.165122 Jun 03 16:17:19.229386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 159/308] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:19 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:19.483707 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:19.484438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:19.491386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.491841 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.492875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.494042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.635367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:19.642722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bc9a28c3-f302-47b6-8532-7cc914a25c47 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.164155 Jun 03 16:17:19.643465 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 150/309] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:19 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:19.768862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:19.769524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:19.775570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.776020 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.776815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.777535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.840850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:19.841730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:19.848453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.849099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.850041 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:19.850755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:19.937725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:19.946102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1daea276-9535-47f4-ad7e-0e08a2771a10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.180964 Jun 03 16:17:19.946828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 160/310] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:19 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:20.069132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:20.079584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:20.082062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:20.082854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ec0e82f9-32e5-4a8d-b74f-4bd3a200e0ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.247449 Jun 03 16:17:20.084086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 151/311] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:19 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:20.246334 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:20.247375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:20.254084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:20.254546 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:20.255417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:20.255801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:20.391605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:20.398896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f8a0c642-0af3-47f2-939d-8b31ac7d6b91 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.156847 Jun 03 16:17:20.399475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 161/312] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:20 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:20.660520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:20.661825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:20.682259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:20.682720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:20.683538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:20.684195 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:20.701608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:20.833121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:20.841379 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-95a20b5e-c0da-460b-a1fc-3146b95886cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.185508 Jun 03 16:17:20.841938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 152/313] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:20 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:20.963634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:20.964240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:20.970201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:20.970645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:20.971435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:20.971871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.101359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:21.101963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:21.108218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:21.110039 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.110871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.111257 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.111954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.117891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a902ea12-2f5c-46e3-b7f3-43638476e23b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.157973 Jun 03 16:17:21.118734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 162/314] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:20 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:21.301590 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:21.317971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:21.319904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:21.331643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-359ebe6f-2118-4f5b-9031-c67719c4a84c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.228485 Jun 03 16:17:21.331643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 153/315] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:21 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:21.416940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:21.417551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:21.424579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.425026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.425796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.426226 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.444352 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:21.453438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-56a5ee9a-9a4e-4cbd-8591-8d87232a843a req-4f1091c1-f20a-4aa7-a549-4b7462b59186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "name": "network-vif-plugged", "status": "completed", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:21.461738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-56a5ee9a-9a4e-4cbd-8591-8d87232a843a req-4f1091c1-f20a-4aa7-a549-4b7462b59186 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.462386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-56a5ee9a-9a4e-4cbd-8591-8d87232a843a req-4f1091c1-f20a-4aa7-a549-4b7462b59186 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.484120 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-56a5ee9a-9a4e-4cbd-8591-8d87232a843a req-4f1091c1-f20a-4aa7-a549-4b7462b59186 service nova] Creating event network-vif-plugged:e842e8b9-3bd1-4f5c-ad08-f8f45d991022 for instance a565de36-676c-4b81-ae49-3dfadf4dbd06 on hv-cinder-83699 Jun 03 16:17:21.490267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-56a5ee9a-9a4e-4cbd-8591-8d87232a843a req-4f1091c1-f20a-4aa7-a549-4b7462b59186 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041220 Jun 03 16:17:21.490854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 154/316] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:17:21.571247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:21.579243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c376a329-cacf-4543-896f-257453f7603e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.166594 Jun 03 16:17:21.579833 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 163/317] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:21 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:21.858613 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:21.859320 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:21.865342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.865785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.866541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:21.866974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:21.999474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:22.006836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9dc44de7-81b9-444f-8354-501c90b91d06 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.152771 Jun 03 16:17:22.007407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 155/318] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:21 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:22.135789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:22.136429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:22.142971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:22.143463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:22.144473 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:22.144917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:22.281173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:22.289004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ae462312-1bc7-4a57-b874-01caad7ba8c9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.157068 Jun 03 16:17:22.289559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 164/319] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:22 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:22.343242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:22.343967 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:22.349885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:22.350332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:22.351097 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:22.351567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:22.481546 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:22.489492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:22.490994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:22.492129 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5c60a7eb-35a4-4ff4-9f2e-ae1fa28ea2c3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.152912 Jun 03 16:17:22.492683 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 156/320] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:22 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:22.595525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:22.596743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:22.602866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:22.603369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:22.604152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:22.604760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:22.763021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:22.770962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0e84198a-7cc2-438b-a269-7d64ffa77206 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.179453 Jun 03 16:17:22.771546 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 165/321] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:22 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:23.024157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:23.024842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:23.032218 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.032742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.033574 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.034075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.161956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:23.169468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e124d5d0-f8ad-4af4-9587-9e8d9e004e76 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.149402 Jun 03 16:17:23.170030 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 157/322] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:23 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:23.306282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:23.307131 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:23.314902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.315423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.316160 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.316598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.463331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:23.473272 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-88d806af-713e-4a4f-9ed6-866a266b0030 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.170644 Jun 03 16:17:23.473848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 166/323] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:23 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:23.509968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:23.510576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:23.516760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.517205 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.520538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.520538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.647152 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:23.656303 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:23.657806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:23.658905 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-18916b15-b7db-449d-b99a-96407c746e46 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.152802 Jun 03 16:17:23.659481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 158/324] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:23 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:23.788414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:23.789299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:23.795881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.796326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.797093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:23.797532 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:23.988597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:23.996629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e7e9f5c4-1ce0-4e30-b785-20949bccef9e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.211992 Jun 03 16:17:23.997586 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 167/325] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:23 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:24.186964 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:24.187975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:24.194486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:24.194932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:24.195719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:24.196160 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:24.327003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:24.336844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b7a896b8-10af-42fc-9993-2d820929031d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.153660 Jun 03 16:17:24.337415 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 159/326] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:24 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:24.490067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:24.491057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:24.497537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:24.498482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:24.499263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:24.500323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:24.677889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:24.678249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:24.678473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:24.685674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:24.686302 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:24.687259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:24.687542 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-633aaa73-9af9-4ab5-b202-85a2a5e73dd5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.201174 Jun 03 16:17:24.687844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:24.688101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 168/327] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:24 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:24.835315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:24.845063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:24.846582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:24.848372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-03a76c0f-2e38-4170-905e-80aea0196998 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.174976 Jun 03 16:17:24.848922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 160/328] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:24 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:25.014039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:25.014645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:25.020545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.020995 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.021755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.022186 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.158753 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:25.168886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8538dc40-79e3-4d87-a65d-e796efc69854 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.158922 Jun 03 16:17:25.169193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 169/329] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:25 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:25.353876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:25.354438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:25.361275 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.361729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.362496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.362937 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.499875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:25.507569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-43d3e463-5f42-4603-a28c-6f5afbfd2c0c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.157577 Jun 03 16:17:25.508133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 161/330] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:25 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:25.705158 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:25.705777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:25.711956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.712405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.713185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.713628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.844640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:25.852070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-67f0c7fa-6658-4e70-a7bd-2eab37dc91c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.151186 Jun 03 16:17:25.852743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 170/331] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:25 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:25.866988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:25.867538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:25.873496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.873941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:25.874709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:25.875173 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:26.013695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:26.021650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:26.023204 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:26.024339 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7229a4f0-1494-42d7-a055-3a5dca4c0d02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.161293 Jun 03 16:17:26.024898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 162/332] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:25 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:26.185315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:26.186192 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:26.192328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:26.192849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:26.193687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:26.194206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:26.331212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:26.339554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7d6e8ad4-3dc3-4c54-ab35-2954ffae63b6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.158137 Jun 03 16:17:26.340792 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 171/333] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:26 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:26.524153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:26.524764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:26.531383 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:26.531831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:26.532589 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:26.533021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:26.670475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:26.677826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-66627b7b-fb83-4577-bb2b-9e97c5e168c5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.157482 Jun 03 16:17:26.678381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 163/334] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:26 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:26.869155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:26.869763 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:26.876467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:26.876921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:26.877710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:26.878184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.008358 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:27.015706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1351a395-0e94-4423-b029-98f03f1e9d9e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.150275 Jun 03 16:17:27.016248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 172/335] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:26 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:27.042164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:27.042773 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:27.049268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:27.049717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.050472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:27.050908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.175779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:27.183826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:27.185397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:27.186619 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7aaee230-52f5-489b-8e8b-df0000926ac9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.148277 Jun 03 16:17:27.187255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 164/336] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:27 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:27.357145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:27.357688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:27.363662 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:27.364116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.364880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:27.365323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.494265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:27.501844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4d9e970c-e2b1-44ee-9aff-0ba725155655 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.149196 Jun 03 16:17:27.502589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 173/337] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:27 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:27.694986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:27.695709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:27.702862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:27.703331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.704100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:27.704544 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:27.981220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:27.992037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-accec259-9fae-4f48-90b1-91ef679f4e7f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.300489 Jun 03 16:17:27.993549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 165/338] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:27 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:28.032672 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:28.033292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:28.039232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:28.039721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:28.040495 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:28.040931 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:28.165862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:28.173167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0dd5c95b-440c-45c9-9934-c8dde128ddb9 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.144333 Jun 03 16:17:28.173718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 174/339] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:28 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:28.204437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:28.205103 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:28.210916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:28.211396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:28.212161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:28.212593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:28.348993 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:28.357458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:28.358962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:28.360086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-56180aa5-9ce2-4d7a-a5a1-3d8727f3960b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.160027 Jun 03 16:17:28.360635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 166/340] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:28 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:17:28.517999 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:28.518505 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:28.524612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:28.525066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:28.525828 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:28.526316 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:28.658168 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:28.668959 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c119d024-4224-462f-a7ba-be478fefa2b8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.154639 Jun 03 16:17:28.670354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 175/341] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:28 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:29.009098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:29.009857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:29.016638 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.017159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.018174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.018647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.155582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:29.162988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-81987a76-53b4-4420-b3fe-9ebe42426e85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.157778 Jun 03 16:17:29.163505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 167/342] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:29 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:29.189687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:29.190383 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:29.196401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.196942 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.197783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.198221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.337128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:29.348350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6f6d8342-dda5-4fbe-aca6-ebba76772eed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.162442 Jun 03 16:17:29.348946 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 176/343] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:29 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:29.378690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:29.379885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:29.386502 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.387055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.388637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.389141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.521613 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:29.530305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:29.532007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:29.533326 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d828e157-a7e6-4247-89ca-5b08799679ad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.159147 Jun 03 16:17:29.533907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 168/344] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:29 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:29.690246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:29.691090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:29.697026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.697474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.698266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:29.698701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:29.824637 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:29.831993 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1450a89d-d701-4a28-8932-31fff247e8ec tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.145629 Jun 03 16:17:29.832556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 177/345] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:29 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:30.178894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:30.179565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:30.181928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:30.187068 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.187547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.188312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.188741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.312721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:30.314980 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:30.321318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6ada7047-c686-4263-85ce-493cf9f1a2e7 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.146219 Jun 03 16:17:30.321873 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 169/346] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:30 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:30.365276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:30.365905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:30.371939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.372384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.373146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.373583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.497529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:30.504940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-167e7b26-8402-4fb4-848f-a7612ee4490e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.143478 Jun 03 16:17:30.505440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 178/347] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:30 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:30.551495 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:30.552102 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:30.557851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.558325 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.559081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.559534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.688039 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:30.696129 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:30.697643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:30.698726 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-78df3083-0f99-42e5-becc-fbb01797d8a1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.151325 Jun 03 16:17:30.699253 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 170/348] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:30 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:30.848627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:30.849142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:30.855060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.855541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.856296 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:30.856724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:30.984580 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:30.992575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3db9e094-54ba-4699-9e37-7f9ebb68a845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.147755 Jun 03 16:17:30.993223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 179/349] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:30 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:31.337868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:31.338482 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:31.344902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:31.345349 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:31.346115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:31.346555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:31.473401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:31.480700 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4557a5d5-52c1-41e7-97dd-df01672cc73e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.146653 Jun 03 16:17:31.481742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 171/350] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:31 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:31.521761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:31.522306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:31.528494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:31.528940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:31.529694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:31.530125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:31.534014 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:31.654834 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:31.662183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d21eb6f4-66f4-43d9-b1f8-3f35a48ad4c7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.144284 Jun 03 16:17:31.662742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 180/351] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:31 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:31.717108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:31.717715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:31.723503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:31.723960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:31.724718 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:31.725152 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:31.846842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:31.854688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:31.856237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:31.857937 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-82ef26db-2141-4aaa-a516-591c94fef95f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.145134 Jun 03 16:17:31.858480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 172/352] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:31 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:32.014945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:32.014945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:32.023036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.023526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.024297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.024736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.159109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:32.167360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7c1e176f-dc67-4729-a16f-7eb7fb9d2530 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.161400 Jun 03 16:17:32.167968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 181/353] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:32 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:32.497706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:32.498393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:32.505182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.505636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.506407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.506846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.635468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:32.643705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5acb41b0-8df7-4f97-b43e-a7f9f290b161 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.150257 Jun 03 16:17:32.644263 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 173/354] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:32 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:32.679947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:32.680610 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:32.687104 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.687582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.688347 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.688781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.821747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:32.829125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2506cb96-bb0e-4157-84ba-1ac4534b4b4e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.152946 Jun 03 16:17:32.829717 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 182/355] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:32 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:32.875739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:32.876341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:32.882410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.882918 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:32.883659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:32.884071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.007912 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:33.015786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:33.017297 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:33.018401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c7eafd4d-de1e-4b87-a9e1-a81c83f67942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.147154 Jun 03 16:17:33.018964 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 174/356] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:32 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:33.184284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:33.184958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:33.190952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:33.191434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.192193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:33.192631 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.316717 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:33.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-68e083de-63d4-42a2-b144-fd7216ea0a46 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.144068 Jun 03 16:17:33.325079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 183/357] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:33 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:33.660589 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:33.661222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:33.667690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:33.668134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.668887 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:33.669316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.846821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:33.847819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:33.854732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:33.855341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.856384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:33.857875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:33.978367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:33.986329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ef6eddf4-5e47-44f0-8e26-2765821a402a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.329732 Jun 03 16:17:33.986894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 175/358] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:33 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:33.993888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:34.001363 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f12daedd-99d8-4a71-9c78-2bb13cab58d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.158528 Jun 03 16:17:34.001933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 184/359] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:33 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:34.036147 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:34.036762 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:34.042698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:34.043153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:34.044542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:34.044992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:34.170772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:34.178603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:34.180144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:34.181242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-944f67bc-2d34-42d3-a516-caffef8ec64c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.148921 Jun 03 16:17:34.181798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 176/360] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:34 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:34.340524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:34.341197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:34.347151 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:34.347635 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:34.348405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:34.348839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:34.473638 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:34.480868 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f97a6b01-d7ff-42d3-9430-c61e8df15b96 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1362 microversion: 2.1 time: 0.144226 Jun 03 16:17:34.481914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 185/361] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:34 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:35.002985 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:35.003722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:35.010662 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.011107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.013845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.014285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.018857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:35.019907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:35.027353 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.027936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.028886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.030141 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.190365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:35.201449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-41379110-549b-468e-9c9a-e668480846f1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.186725 Jun 03 16:17:35.207450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 186/362] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:35 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:35.213590 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-cc3bc596-06da-4ce4-95b8-4a32ad6836b0 req-99975999-c422-482f-8596-278d768e0c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab42cfc-29a0-4c3f-b30b-e5902d661dd2", "name": "network-vif-plugged", "status": "completed", "tag": "d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:35.226801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:35.229567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-cc3bc596-06da-4ce4-95b8-4a32ad6836b0 req-99975999-c422-482f-8596-278d768e0c9c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.229567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-cc3bc596-06da-4ce4-95b8-4a32ad6836b0 req-99975999-c422-482f-8596-278d768e0c9c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.240878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-cc3bc596-06da-4ce4-95b8-4a32ad6836b0 req-99975999-c422-482f-8596-278d768e0c9c service nova] Creating event network-vif-plugged:d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6 for instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 on hv-cinder-83699 Jun 03 16:17:35.246605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-90c5d805-ef62-425d-bb81-b73babc6c7d2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.247344 Jun 03 16:17:35.247508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-cc3bc596-06da-4ce4-95b8-4a32ad6836b0 req-99975999-c422-482f-8596-278d768e0c9c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043252 Jun 03 16:17:35.248875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 187/363] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:17:35.252675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 177/364] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:34 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:35.265803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:35.267000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:35.273630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.274076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.274842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.275416 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.418874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:35.427061 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:35.428591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:35.429673 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5c336683-eafd-4dad-b4dd-77bddca098dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.179238 Jun 03 16:17:35.430219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 188/365] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:35 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:35.498219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:35.498963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:35.505223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.505680 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.506449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.506900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.650234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:35.662865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-18073664-c221-416e-ae66-2d47450219d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1548 microversion: 2.1 time: 0.168672 Jun 03 16:17:35.663821 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 178/366] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:35 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:35.681552 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:35.682050 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:35.689068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.689515 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.690315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:35.690755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:35.818106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2f5c554c-9cda-42b2-b641-591a348579e0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141323 Jun 03 16:17:35.824651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 189/367] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:17:35 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:17:36.218712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:36.219450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:36.226628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:36.227484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:36.228412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:36.228996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:36.269299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:36.269906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:36.277674 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:36.278363 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:36.279140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:36.279634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:36.442072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:36.451351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6e58aebe-5d0d-4837-8a22-5a706eb5086b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.236653 Jun 03 16:17:36.452465 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 179/368] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:36 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:36.457988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:36.458907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:36.465399 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:36.465815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:36.466747 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:36.467369 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:36.666934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:36.676522 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:36.679159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:36.680326 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f2b31c75-33f6-4949-93aa-da9b8de0851c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1405 microversion: 2.20 time: 0.226808 Jun 03 16:17:36.680875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 180/369] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:36 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:36.780089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:36.797291 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b24b8d64-8115-4cad-8c8a-a0675ea42123 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.531734 Jun 03 16:17:36.806944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 190/370] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:36 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:37.239268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-56256277-7936-41bb-b0d3-b80ef2b5b9aa req-a5ecf33e-918f-496e-994c-b5d107c3c740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de1f638-4fee-41e2-bd50-b802f8494fad", "tag": "fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:37.253906 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-56256277-7936-41bb-b0d3-b80ef2b5b9aa req-a5ecf33e-918f-496e-994c-b5d107c3c740 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.253906 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-56256277-7936-41bb-b0d3-b80ef2b5b9aa req-a5ecf33e-918f-496e-994c-b5d107c3c740 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.267508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-56256277-7936-41bb-b0d3-b80ef2b5b9aa req-a5ecf33e-918f-496e-994c-b5d107c3c740 service nova] Creating event network-changed:fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c for instance 2de1f638-4fee-41e2-bd50-b802f8494fad on hv-cinder-83699 Jun 03 16:17:37.273088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-56256277-7936-41bb-b0d3-b80ef2b5b9aa req-a5ecf33e-918f-496e-994c-b5d107c3c740 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037213 Jun 03 16:17:37.274058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 181/371] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:17:37.469427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:37.470136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:37.481048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.481534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.482539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.486487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.657260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:37.666683 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f4728174-354e-468c-9b40-65759e16541d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1321 microversion: 2.1 time: 0.201495 Jun 03 16:17:37.667513 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 191/372] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:37 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:37.701954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:37.702721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:37.710535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.710996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.711829 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.712272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.814445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:37.815059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:37.821225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.821933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.822731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.823231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.858432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:37.866982 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:37.868716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:37.870016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-339ec48f-0b18-42c6-aad2-0842814ffc32 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1597 microversion: 2.20 time: 0.174919 Jun 03 16:17:37.870571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 182/373] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:17:37 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:17:37.889499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:37.890010 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:37.896716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.897169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.897955 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:37.898393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:37.961721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:37.969812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-aafdee83-0181-423d-8183-7d616b5fe711 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.159044 Jun 03 16:17:37.970388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 192/374] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:37 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:37.977241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6ffd677f-b2cb-4a5b-b0fe-93fa542ee463 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092244 Jun 03 16:17:37.978054 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 183/375] 10.222.0.41 () {60 vars in 1315 bytes} [Fri Jun 3 16:17:37 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 16:17:38.685150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:38.685771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:38.692107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:38.695816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:38.696760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:38.697089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:38.864784 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:38.874878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f8b3bbae-5c01-49e6-b598-b7df0213611a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1515 microversion: 2.1 time: 0.194437 Jun 03 16:17:38.876033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 193/376] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:38 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:38.903530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:38.903530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:38.918248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:38.919260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:38.921420 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:38.921882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:38.976701 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lazy-loading 'flavor' on Instance uuid 4c90b829-8496-4298-b54d-fd9a976bbae3 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:17:38.992502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:38.993118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:39.004524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:39.005029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:39.005925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:39.006380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:39.164015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6da0460b-98f2-476a-91d1-c53d7396c5a5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3/action" status: 200 len: 32 microversion: 2.1 time: 0.266538 Jun 03 16:17:39.165546 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 184/377] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:17:38 2022] POST /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:17:39.175871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:39.177379 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:39.184268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:39.184709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:39.185171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:39.186169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:39.186760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:39.194350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d307f15a-c5e1-48cb-9f37-dab3bd504a24 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.205431 Jun 03 16:17:39.195507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 194/378] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:38 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:39.203950 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:39.411739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:39.423465 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-7adb74fd-f7c3-4d1d-aa8f-b5f2bdcee246 req-3d598682-c1a6-419b-8a9d-d1109afde7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:39.429480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d6f5120d-3d35-4d63-a486-9fbb5309ac39 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.258588 Jun 03 16:17:39.431794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 185/379] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:39 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:39.441539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-7adb74fd-f7c3-4d1d-aa8f-b5f2bdcee246 req-3d598682-c1a6-419b-8a9d-d1109afde7ae service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:39.441885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-7adb74fd-f7c3-4d1d-aa8f-b5f2bdcee246 req-3d598682-c1a6-419b-8a9d-d1109afde7ae service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:39.463930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-7adb74fd-f7c3-4d1d-aa8f-b5f2bdcee246 req-3d598682-c1a6-419b-8a9d-d1109afde7ae service nova] Creating event network-changed:e842e8b9-3bd1-4f5c-ad08-f8f45d991022 for instance a565de36-676c-4b81-ae49-3dfadf4dbd06 on hv-cinder-83699 Jun 03 16:17:39.470690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-7adb74fd-f7c3-4d1d-aa8f-b5f2bdcee246 req-3d598682-c1a6-419b-8a9d-d1109afde7ae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051514 Jun 03 16:17:39.472220 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 195/380] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:17:40.211759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:40.213115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:40.222976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:40.223797 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:40.224867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:40.225517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:40.447640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:40.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:40.462455 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:40.465108 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:40.468027 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:40.469470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:40.662751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:40.670413 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d1e5a97b-c979-477f-b1df-413f91822829 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.462460 Jun 03 16:17:40.670984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 186/381] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:40 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:40.688227 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:40.696115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cfac0bae-cad2-4e03-89ca-99e4764d7b29 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.253202 Jun 03 16:17:40.706740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 196/382] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:40 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:41.687634 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:41.688254 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:41.695152 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:41.695635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:41.696527 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:41.696965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:41.714536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:41.715144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:41.730273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:41.730832 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:41.732464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:41.732990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:41.848503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:41.859273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ec5ef470-b58a-481e-bbaa-0d3005a7cd57 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.175321 Jun 03 16:17:41.860246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 187/383] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:41 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:41.889571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:41.897805 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c9e949f1-8052-432a-883c-c6a2475ad14f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.187720 Jun 03 16:17:41.898336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 197/384] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:41 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:42.876519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:42.877136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:42.883554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:42.884000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:42.884759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:42.885192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:42.916773 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:42.917306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:42.924036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:42.924485 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:42.925305 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:42.925740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:42.943685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:43.016319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:43.024224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-77ad4472-d146-4a5c-b403-2145f2f46a3b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.151430 Jun 03 16:17:43.024807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 188/385] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:42 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:43.063496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:43.071497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a4474466-0b1a-4265-8db1-7b20add5919c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.158486 Jun 03 16:17:43.072063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 198/386] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:42 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:44.041355 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:44.041965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:44.048879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:44.049323 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:44.050076 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:44.050508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:44.087569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:44.088207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:44.094293 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:44.094736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:44.095521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:44.095955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:44.187359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:44.195041 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-830e0334-fa9a-46b8-b052-90158f1ef94f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.157464 Jun 03 16:17:44.195638 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 189/387] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:44 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:44.228621 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:44.236914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ba0cfb14-0bd2-48fc-a65f-2955632c7ecf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.153069 Jun 03 16:17:44.237467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 199/388] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:44 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:45.211546 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:45.212155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:45.218564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.219013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.219807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.220240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.253727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:45.254732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:45.260714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.261154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.261926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.263004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.392654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:45.402984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fef9aee7-347c-4db5-9c7e-e4be6f86fd6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.195158 Jun 03 16:17:45.403885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 190/389] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:45 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:45.549933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:45.558368 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-639af87d-ec08-48ba-b3c3-56da8fc4b510 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.308391 Jun 03 16:17:45.569703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 200/390] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:45 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:45.669464 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:45.669956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:45.675897 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.676343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.677100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.677530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.714542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:17:45.802748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7b1ad52c-b1d6-428c-8d34-acfbdd4d5709 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 204 len: 0 microversion: 2.1 time: 0.136761 Jun 03 16:17:45.803453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 191/391] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:17:45 2022] DELETE /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:17:45.811911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:45.812538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:45.818775 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.819223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.820036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:45.820801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:45.994173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:46.002632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b3275237-105f-49a7-b8bd-8772646ef905 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.194628 Jun 03 16:17:46.003193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 201/392] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:45 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:46.421623 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:46.422496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:46.429580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:46.430022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:46.430778 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:46.431207 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:46.560480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:46.567828 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fbb7b3a0-6bfe-4b37-9e30-d15db1cd4f23 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.151309 Jun 03 16:17:46.568378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 192/393] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:46 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:46.575126 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:46.575975 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:46.582127 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:46.582583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:46.583387 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:46.583864 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:46.707017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:46.714745 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0405c771-03c3-40a4-83e9-fc13a1e7c318 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.143481 Jun 03 16:17:46.715845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 202/394] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:46 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:47.019418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:47.019978 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:47.025967 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:47.026418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:47.027459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:47.028513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:47.155893 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:47.164004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cf55a294-45d7-4a91-aee1-b121f7979673 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.148477 Jun 03 16:17:47.164592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 193/395] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:47 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:47.584272 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:47.584918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:47.591080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:47.591619 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:47.592394 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:47.592834 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:47.719250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:47.726690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-50d1d20b-c2c0-4c92-8643-322d3d4bc0d4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.146643 Jun 03 16:17:47.727256 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 203/396] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:47 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:47.732571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:47.733189 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:47.739587 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:47.740036 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:47.740795 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:47.741228 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:47.870474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:47.878781 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2ac80308-543d-4449-af4e-160a7ed23171 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.150460 Jun 03 16:17:47.879371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 194/397] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:47 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:48.179889 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:48.180534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:48.186504 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:48.186954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:48.187758 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:48.188196 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:48.314097 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:48.322206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1f2f9896-564b-4203-9aa3-1e2e384be1a9 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.146067 Jun 03 16:17:48.322701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 204/398] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:48 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:48.751937 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:48.755213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:48.782345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:48.784790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:48.787943 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:48.788843 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:48.895769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:48.896378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:48.901406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=93 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:48.909808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:48.910331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:48.912342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:48.913024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:48.981819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:48.989853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a411f4ac-e57d-4e61-b468-7e2ee797766b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1367 microversion: 2.1 time: 0.247743 Jun 03 16:17:48.990623 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 195/399] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:48 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:49.217917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:49.226199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4d2a6b4e-08b9-4e0f-bbbc-026b0c65fd07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.334139 Jun 03 16:17:49.226769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 205/400] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:48 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:49.338438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:49.339171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:49.345260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:49.345706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:49.346466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:49.346898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:49.479057 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:49.487557 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-24bec6e0-6790-4ac9-b2a3-4dc47945b076 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.152944 Jun 03 16:17:49.488121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 196/401] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:49 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:50.008888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:50.009528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:50.015609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.016061 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.016830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.017296 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.146906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:50.155068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a3909b77-91ea-4b57-b4d8-bd22956f0d85 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1558 microversion: 2.1 time: 0.151880 Jun 03 16:17:50.155628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 206/402] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:50 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:50.172298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:50.172791 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:50.179408 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.179939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.180830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.181359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.243918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:50.244631 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:50.250980 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.251544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.252472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.253134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.270011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b50cccb8-2326-4959-85d7-5b80d2b5c89f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101383 Jun 03 16:17:50.270686 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 197/403] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:17:50 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:17:50.398806 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:50.407966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-29b97682-1e6c-4697-a201-9ad11f597d5d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.167858 Jun 03 16:17:50.408674 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 207/404] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:50 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:50.504511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:50.505033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:50.510988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.511589 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.513009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:50.513834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:50.760749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:50.769556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7c9fabe9-aa20-433c-8a5a-50ac1ae06cf4 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.268823 Jun 03 16:17:50.779865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 198/405] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:50 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:51.269470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-60ce9dc3-ed0b-4d93-90a1-4bffa3fb1917 req-396d8073-d203-4aed-b5a4-2e0fffa96470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab42cfc-29a0-4c3f-b30b-e5902d661dd2", "tag": "d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:51.278123 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-60ce9dc3-ed0b-4d93-90a1-4bffa3fb1917 req-396d8073-d203-4aed-b5a4-2e0fffa96470 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:51.278567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-60ce9dc3-ed0b-4d93-90a1-4bffa3fb1917 req-396d8073-d203-4aed-b5a4-2e0fffa96470 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:51.289679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-60ce9dc3-ed0b-4d93-90a1-4bffa3fb1917 req-396d8073-d203-4aed-b5a4-2e0fffa96470 service nova] Creating event network-changed:d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6 for instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 on hv-cinder-83699 Jun 03 16:17:51.294631 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-60ce9dc3-ed0b-4d93-90a1-4bffa3fb1917 req-396d8073-d203-4aed-b5a4-2e0fffa96470 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028827 Jun 03 16:17:51.295210 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 208/406] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:17:51.425086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:51.425680 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:51.432001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:51.432452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:51.433253 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:51.433690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:51.562419 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:51.569923 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-93f79172-caff-4dc7-9a8e-3d4c2504c037 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.148668 Jun 03 16:17:51.570593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 199/407] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:51 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:51.786613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:51.787338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:51.794006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:51.794447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:51.795208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:51.795672 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:51.929349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:51.937723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d9c7d6ca-8af9-4d7d-b177-bd2f4fe3f77b tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.155356 Jun 03 16:17:51.938307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 209/408] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:51 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:52.586975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:52.587548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:52.594571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:52.595024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:52.595820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:52.596262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:52.720856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:52.723110 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:52.729987 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1797c97e-84e7-4ea5-9d21-164822f6bf36 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.146940 Jun 03 16:17:52.731128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 200/409] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:52 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:52.955376 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:52.955989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:52.961981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:52.962433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:52.963205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:52.963671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:53.101935 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:53.109949 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3e128ad1-85b8-4cee-8792-6a0a2a6cef8a tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.158463 Jun 03 16:17:53.110499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 210/410] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:52 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:53.746738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:53.747368 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:53.754626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:53.755075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:53.755860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:53.756304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:53.877844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:53.885181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e18ea9ef-9d1c-4fba-802d-03f678e627e3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.142637 Jun 03 16:17:53.885738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 201/411] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:53 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:54.126768 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:54.127441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:54.133384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:54.133836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:54.134610 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:54.135046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:54.270684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:54.278842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fd60f6b6-1b3c-4dfb-a6f7-3d4c54fdde75 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.155946 Jun 03 16:17:54.279415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 211/412] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:54 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:54.902772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:54.903534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:54.910170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:54.910716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:54.911692 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:54.912200 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:55.265758 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-230181811", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:55.318246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] validate_networks() for None {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:17:55.491229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:55.500034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-82d7e9b6-3d2a-4abe-beb2-fa6b7d79a00b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.601824 Jun 03 16:17:55.507971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 202/413] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:54 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:55.514481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:55.515116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:55.521644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:55.522062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:55.522841 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:55.523281 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:55.598755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:17:55.599212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:17:55.599724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:17:55.600135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:17:55.600578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:17:55.628407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:55.628869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:55.629690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:55.630706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:55.647596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Getting quotas for project 09848a8d962b47439b233d1f06bf72e3. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:17:55.651796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Getting quotas for user 334e442aa8d348beaa8dde1f78f5c68d and project 09848a8d962b47439b233d1f06bf72e3. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:17:55.663407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:17:55.665689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:17:55.717738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a33cb52d-4f25-472e-a434-def46938a90a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.455513 Jun 03 16:17:55.718594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 212/414] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:17:55.729468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-630da941-e0c2-4d60-bd22-1c0425ea9859 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:55.730115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-630da941-e0c2-4d60-bd22-1c0425ea9859 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:55.816688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-630da941-e0c2-4d60-bd22-1c0425ea9859 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:55.823564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-630da941-e0c2-4d60-bd22-1c0425ea9859 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1214 microversion: 2.1 time: 0.098858 Jun 03 16:17:55.826211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 213/415] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:55 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:55.857219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:55.868870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c765e568-1c78-4b45-8d2e-ea4c29a171c2 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1554 microversion: 2.1 time: 0.358088 Jun 03 16:17:55.870165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 203/416] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:55 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1554 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:56.279538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-95a98c69-16a4-4bd1-8086-2483fb30bc23 req-d3f52fb9-909f-4aef-916b-5023eed0b365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd398f1-b836-4cf5-9735-ed63505630a7", "name": "network-vif-deleted", "tag": "faed89f2-da2d-4cf7-b471-15a07783c520"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:56.289393 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-95a98c69-16a4-4bd1-8086-2483fb30bc23 req-d3f52fb9-909f-4aef-916b-5023eed0b365 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.289592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-95a98c69-16a4-4bd1-8086-2483fb30bc23 req-d3f52fb9-909f-4aef-916b-5023eed0b365 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.302492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-95a98c69-16a4-4bd1-8086-2483fb30bc23 req-d3f52fb9-909f-4aef-916b-5023eed0b365 service nova] Creating event network-vif-deleted:faed89f2-da2d-4cf7-b471-15a07783c520 for instance bdd398f1-b836-4cf5-9735-ed63505630a7 on hv-cinder-83699 Jun 03 16:17:56.308346 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-95a98c69-16a4-4bd1-8086-2483fb30bc23 req-d3f52fb9-909f-4aef-916b-5023eed0b365 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035023 Jun 03 16:17:56.315751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 214/417] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:17:56.517253 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:56.517864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:56.531841 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.532285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.533083 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.533507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.678486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:56.687081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bb56ba8e-f716-4ef3-8cca-b125822cb98a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.174634 Jun 03 16:17:56.688816 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 204/418] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:56 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:56.841523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:56.842375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:56.848657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.849106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.849869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.850306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.887427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:56.888621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:56.895655 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.896381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.897635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:56.898530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:56.918685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:56.926526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7406ef3a-6997-441d-997e-5e41d4693e71 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1266 microversion: 2.1 time: 0.089451 Jun 03 16:17:56.935645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 215/419] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:56 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:56.965565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ca0974e6dd49bdb6a56ec577dad3cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1dde95632be44e29e77bfddc2ad84b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:56.974516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9ab2fa52-ee9e-4565-bd63-7ca8f0a067ed tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 200 len: 1346 microversion: 2.1 time: 0.091284 Jun 03 16:17:56.975276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 205/420] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:56 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:57.705640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:57.706249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:57.713136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:57.713810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:57.714622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:57.715181 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:57.911407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:57.922447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d5b25e99-907d-49a1-9360-d754e54fde81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.221140 Jun 03 16:17:57.923367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 216/421] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:57 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:57.946421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:57.947052 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:57.955230 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:57.955714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:57.956500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:57.956944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:57.999922 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:58.001024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:58.007587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:58.008250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:58.009244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:58.010042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:58.026205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] HTTP exception thrown: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Request method failure captured: Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 HTTP/1.1 Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjOsObimU-3hOvHTbdj4oiMp7u9lOaWlHkGjuktgWItYLj-7I507aPxbsYC7Fg21IDRMnYgLNLu3sT2RwARC0_TkGMAfxT6IPAMGvDhrBm7H_OYYRsLDWoTyfLnI2kg-njZ8GAJF_H29nOirqnJUqZKo_Mmpj68EmDGQhZgd9BxnGmo Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:17:58.032307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b1dde95632be44e29e77bfddc2ad84b5"}]}] Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 34ca0974e6dd49bdb6a56ec577dad3cb Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.033615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'bdd398f1-b836-4cf5-9735-ed63505630a7'} Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:17:58.034301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.035480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.036554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Returning 404 to user: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:17:58.036627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:58.036714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ec6b9e61-fcb1-4523-a32d-76efb0e723f3 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 404 len: 111 microversion: 2.1 time: 0.046084 Jun 03 16:17:58.036714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 217/422] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:57 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 16:17:58.044730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f33c95f3-c3e7-4d14-9e0a-f6c904c7a014 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1272 microversion: 2.1 time: 0.103327 Jun 03 16:17:58.045476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 206/423] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:57 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:58.158481 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:58.159625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:58.166375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:58.166836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:58.167648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:58.168119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:58.181934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] HTTP exception thrown: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Request method failure captured: Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7/os-volume_attachments HTTP/1.1 Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjOsObimU-3hOvHTbdj4oiMp7u9lOaWlHkGjuktgWItYLj-7I507aPxbsYC7Fg21IDRMnYgLNLu3sT2RwARC0_TkGMAfxT6IPAMGvDhrBm7H_OYYRsLDWoTyfLnI2kg-njZ8GAJF_H29nOirqnJUqZKo_Mmpj68EmDGQhZgd9BxnGmo Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:17:58.184576 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b1dde95632be44e29e77bfddc2ad84b5"}]}] Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 34ca0974e6dd49bdb6a56ec577dad3cb Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.185976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'server_id': 'bdd398f1-b836-4cf5-9735-ed63505630a7'} Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:17:58.186794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:58.187903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:58.188954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Returning 404 to user: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:17:58.188954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fc62c684-d53b-41b0-a76a-f48dae7bd7ff tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032560 Jun 03 16:17:58.188954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 218/424] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:17:58 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:17:58.941193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:58.942077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:58.948664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:58.949973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:58.950618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:58.951242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.062467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:59.062923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:59.102471 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.103211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.115848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.120232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.151811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:17:59.196115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:59.203994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bf9e36c3-7cc0-4bd8-b10f-187b2940e4a4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.267039 Jun 03 16:17:59.205069 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 207/425] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:58 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:17:59.209540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-f2a6ec2a-1f55-4b2e-ad0f-6d1c0f877ec8 req-5083fd59-e7dd-4e32-b400-ba7333f955c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afeb9bbb-035f-454f-be46-f05542854e35", "tag": "6dfc99bb-a56a-4062-b9d9-fa0c2c4b7292"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:17:59.219092 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-f2a6ec2a-1f55-4b2e-ad0f-6d1c0f877ec8 req-5083fd59-e7dd-4e32-b400-ba7333f955c1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.219563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-f2a6ec2a-1f55-4b2e-ad0f-6d1c0f877ec8 req-5083fd59-e7dd-4e32-b400-ba7333f955c1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.237572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-f2a6ec2a-1f55-4b2e-ad0f-6d1c0f877ec8 req-5083fd59-e7dd-4e32-b400-ba7333f955c1 service nova] Creating event network-changed:6dfc99bb-a56a-4062-b9d9-fa0c2c4b7292 for instance afeb9bbb-035f-454f-be46-f05542854e35 on hv-cinder-83699 Jun 03 16:17:59.242798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-f2a6ec2a-1f55-4b2e-ad0f-6d1c0f877ec8 req-5083fd59-e7dd-4e32-b400-ba7333f955c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036412 Jun 03 16:17:59.243633 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 208/426] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:17:59.391062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:17:59.403848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0ffe2ea6-1231-466e-b6e1-d26f4acb0088 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.345848 Jun 03 16:17:59.404431 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 219/427] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:59 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:17:59.413919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:59.414747 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:59.421721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.422167 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.422937 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.423448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.437645 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] HTTP exception thrown: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Request method failure captured: Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: DELETE /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 HTTP/1.1 Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjOsObimU-3hOvHTbdj4oiMp7u9lOaWlHkGjuktgWItYLj-7I507aPxbsYC7Fg21IDRMnYgLNLu3sT2RwARC0_TkGMAfxT6IPAMGvDhrBm7H_OYYRsLDWoTyfLnI2kg-njZ8GAJF_H29nOirqnJUqZKo_Mmpj68EmDGQhZgd9BxnGmo Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:17:59.445677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b1dde95632be44e29e77bfddc2ad84b5"}]}] Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 34ca0974e6dd49bdb6a56ec577dad3cb Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.446831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'bdd398f1-b836-4cf5-9735-ed63505630a7'} Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:17:59.447531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.448584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.449673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Returning 404 to user: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:17:59.449673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-843b3eb9-11ec-4edd-bedb-395ce4b6c0f0 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 404 len: 111 microversion: 2.1 time: 0.038061 Jun 03 16:17:59.449673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 209/428] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:17:59 2022] DELETE /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:17:59.458902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:17:59.459916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] [instance: bdd398f1-b836-4cf5-9735-ed63505630a7] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:17:59.469253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.469741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.470624 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:17:59.471287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:17:59.490626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] HTTP exception thrown: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Request method failure captured: Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 HTTP/1.1 Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjOsObimU-3hOvHTbdj4oiMp7u9lOaWlHkGjuktgWItYLj-7I507aPxbsYC7Fg21IDRMnYgLNLu3sT2RwARC0_TkGMAfxT6IPAMGvDhrBm7H_OYYRsLDWoTyfLnI2kg-njZ8GAJF_H29nOirqnJUqZKo_Mmpj68EmDGQhZgd9BxnGmo Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:17:59.492206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b1dde95632be44e29e77bfddc2ad84b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b1dde95632be44e29e77bfddc2ad84b5"}]}] Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: b1dde95632be44e29e77bfddc2ad84b5 Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-DeleteServersTestJSON-973382803 Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 34ca0974e6dd49bdb6a56ec577dad3cb Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-DeleteServersTestJSON-973382803-project Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.493482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'bdd398f1-b836-4cf5-9735-ed63505630a7'} Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:17:59.494132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. Jun 03 16:17:59.495167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:17:59.496273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] Returning 404 to user: Instance bdd398f1-b836-4cf5-9735-ed63505630a7 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:17:59.496273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-32735898-68bb-4019-996b-b76addf183c6 tempest-DeleteServersTestJSON-973382803 tempest-DeleteServersTestJSON-973382803-project] 10.222.0.41 "GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7" status: 404 len: 111 microversion: 2.1 time: 0.040617 Jun 03 16:17:59.496273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 220/429] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:17:59 2022] GET /compute/v2.1/servers/bdd398f1-b836-4cf5-9735-ed63505630a7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:18:00.221356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:00.222570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:00.233535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:00.236540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:00.237286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:00.238301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:00.238798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:00.420335 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:00.420953 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:00.427166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:00.427667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:00.428460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:00.428896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:00.435972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:00.444146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7abc9c4b-593d-49e9-a939-cb04dd901154 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.226763 Jun 03 16:18:00.444963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 210/430] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:00 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:00.805131 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:00.813618 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8eee5436-0f45-479f-ad54-96d9d981ca77 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.397022 Jun 03 16:18:00.814191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 221/431] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:00 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:01.461618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:01.462289 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:01.469272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:01.469717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:01.470476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:01.470913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:01.609875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:01.619939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-45dc5273-c23e-4039-aefa-103ee6501711 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.161982 Jun 03 16:18:01.620558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 211/432] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:01 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:01.830166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:01.830920 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:01.837048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:01.837494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:01.838278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:01.838700 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:01.970585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:01.978161 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-316b347c-717c-47f2-be90-9361bcab4600 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.151819 Jun 03 16:18:01.978722 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 222/433] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:01 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:02.638316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:02.639220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:02.648341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:02.648828 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:02.649652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:02.650038 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:02.791245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:02.799858 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ef1e24f0-62dd-4314-8db3-39ba12b4a97b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.166264 Jun 03 16:18:02.800423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 212/434] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:02 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:02.996802 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:02.997695 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:03.004296 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:03.004744 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:03.005510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:03.005941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:03.200571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:03.216029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-797c5e50-9b95-4ab7-8468-8889145591df tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.223646 Jun 03 16:18:03.217154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 223/435] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:02 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:03.817877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:03.818387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:03.825449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:03.825809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:03.826562 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:03.826989 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:03.969464 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:03.977133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e4d1fb9b-0967-4e70-9476-cd916e2baedc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.163135 Jun 03 16:18:03.977841 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 213/436] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:03 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:04.234155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:04.234948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:04.241013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:04.241470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:04.242244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:04.242682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:04.389679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:04.399937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4f584f86-64ed-4520-b0ee-28db809b3d31 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.170316 Jun 03 16:18:04.400596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 224/437] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:04 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:18:04.994093 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:04.994703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:05.000843 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:05.001287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:05.002042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:05.002471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:05.143895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:05.151793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-23a8cf6d-a774-41de-97fa-d5ca2c916747 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.161579 Jun 03 16:18:05.152826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 214/438] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:04 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:05.417599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:05.418219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:05.424338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:05.424783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:05.425582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:05.426024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:05.561843 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:05.569299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4a71b7f0-ddec-4090-9365-42d2b5073494 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.155386 Jun 03 16:18:05.569797 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 225/439] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:05 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:18:05.655071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-c5c06897-36ab-44d6-b681-adfe981e4e85 req-bc994f27-cce8-48b3-87b2-b9216ded740c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afeb9bbb-035f-454f-be46-f05542854e35", "name": "network-vif-plugged", "status": "completed", "tag": "6dfc99bb-a56a-4062-b9d9-fa0c2c4b7292"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:05.664318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-c5c06897-36ab-44d6-b681-adfe981e4e85 req-bc994f27-cce8-48b3-87b2-b9216ded740c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:05.664950 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-c5c06897-36ab-44d6-b681-adfe981e4e85 req-bc994f27-cce8-48b3-87b2-b9216ded740c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:05.675978 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-c5c06897-36ab-44d6-b681-adfe981e4e85 req-bc994f27-cce8-48b3-87b2-b9216ded740c service nova] Creating event network-vif-plugged:6dfc99bb-a56a-4062-b9d9-fa0c2c4b7292 for instance afeb9bbb-035f-454f-be46-f05542854e35 on hv-cinder-83699 Jun 03 16:18:05.681838 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-c5c06897-36ab-44d6-b681-adfe981e4e85 req-bc994f27-cce8-48b3-87b2-b9216ded740c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Jun 03 16:18:05.683870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 215/440] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:18:06.169329 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:06.169996 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:06.171856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:06.172571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=8 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:06.178757 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:06.179209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:06.180013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:06.180452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:06.322664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:06.332106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a9f7ca1c-041e-4af2-9ce2-21006cece7cd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.167108 Jun 03 16:18:06.332756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 226/441] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:06 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:06.587250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:06.588013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:06.595206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:06.595715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:06.596497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:06.596939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:06.736923 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:06.744935 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f5df03d0-6d51-417b-b646-e487f0043a42 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.161677 Jun 03 16:18:06.745555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 216/442] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:06 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:07.349624 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:07.350244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:07.357303 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:07.357880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:07.358826 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:07.359433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:07.544245 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:07.552568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7590e60b-54ea-4431-9509-09dc031bb11c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.206945 Jun 03 16:18:07.553132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 227/443] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:07 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:07.770299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:07.771712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:07.780733 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:07.781217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:07.781914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:07.782316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:07.919580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:07.927086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ba78e871-34c4-4688-a51b-79f79ff86dc1 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1314 microversion: 2.1 time: 0.168991 Jun 03 16:18:07.927676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 217/444] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:07 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:08.569825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:08.570552 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:08.577279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:08.577738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:08.578632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:08.579077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:08.730198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:08.738223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5d18335a-19a4-491e-91e7-1dc051ff0d07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.172155 Jun 03 16:18:08.738976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 228/445] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:08 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:08.942947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:08.943593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:08.949991 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:08.950446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:08.951198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:08.951662 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.102004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:09.110426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7ae2adef-87dc-4d5d-b10f-27ccc83b59d7 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1464 microversion: 2.1 time: 0.171180 Jun 03 16:18:09.111017 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 218/446] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:08 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:09.176512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:09.176955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:09.182908 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:09.183401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.184165 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:09.184602 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.209480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:18:09.315761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5d9af6d0-f1d9-432e-a9df-eb41f72e07af tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "DELETE /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 204 len: 0 microversion: 2.1 time: 0.142881 Jun 03 16:18:09.316560 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 229/447] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:18:09 2022] DELETE /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:18:09.325479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:09.326176 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:09.332608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:09.333050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.333802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:09.334229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.352362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:09.466970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:09.474330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-16949292-692b-4538-af38-94e454986c80 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1470 microversion: 2.1 time: 0.152891 Jun 03 16:18:09.474895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 219/448] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:09 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:09.757584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:09.758283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:09.765268 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:09.765720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.766490 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:09.766924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:09.905303 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:09.912872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-55c4611a-d05c-4d86-a2e4-5f245a6a314f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.159558 Jun 03 16:18:09.913425 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 230/449] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:09 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:10.491856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:10.492605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:10.499741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:10.500262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:10.501102 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:10.501611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:10.635252 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:10.643268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8b1042ce-9c60-4ed4-aa21-176f6776b76a tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1470 microversion: 2.1 time: 0.155071 Jun 03 16:18:10.644116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 220/450] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:10 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:10.929912 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:10.930523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:10.937629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:10.938083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:10.938857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:10.939410 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:11.087666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:11.095216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fde97d09-8d98-438d-a5a4-bca0452cb513 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.169147 Jun 03 16:18:11.095817 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 231/451] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:10 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:11.661418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:11.662061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:11.669098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:11.669551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:11.670309 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:11.670748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:11.800033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:11.807517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cd2818bd-1c86-4e56-ac34-5f5365fdfe21 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1470 microversion: 2.1 time: 0.150004 Jun 03 16:18:11.808138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 221/452] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:11 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:12.114849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:12.115504 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:12.132339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:12.132860 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:12.133654 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:12.134086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:12.263753 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:12.271138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c143af26-3978-4181-9c32-6e90e17e4a07 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.161664 Jun 03 16:18:12.271721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 232/453] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:12 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:12.823812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:12.824452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:12.830911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:12.831399 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:12.832166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:12.832603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:12.963343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:12.971242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-17eeb15a-758d-4f6b-aa40-ab8c9fe9d0d8 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1470 microversion: 2.1 time: 0.151322 Jun 03 16:18:12.971826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 222/454] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:12 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:13.288193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:13.288804 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:13.295238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:13.295717 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:13.296478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:13.296914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:13.429266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:13.437372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ad53bd1e-8b49-4d99-8b69-44ae06816800 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.153014 Jun 03 16:18:13.437932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 233/455] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:13 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:13.988604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:13.989177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:13.996125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:13.996600 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:13.997385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:13.997820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:14.141747 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:14.155425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7bab8c57-ff14-4ac4-a0c1-23a67162023c tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1470 microversion: 2.1 time: 0.169702 Jun 03 16:18:14.156453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 223/456] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:13 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:14.455061 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:14.456174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:14.463933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:14.465467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:14.466479 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:14.466982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:14.675605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-71ccf9b7-403a-4d51-a6e7-f86e7312093d req-a1f4df29-dcad-48c8-a806-dcda753b7b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afeb9bbb-035f-454f-be46-f05542854e35", "name": "network-vif-deleted", "tag": "6dfc99bb-a56a-4062-b9d9-fa0c2c4b7292"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:14.686351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-71ccf9b7-403a-4d51-a6e7-f86e7312093d req-a1f4df29-dcad-48c8-a806-dcda753b7b18 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:14.687170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-71ccf9b7-403a-4d51-a6e7-f86e7312093d req-a1f4df29-dcad-48c8-a806-dcda753b7b18 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:14.700530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-71ccf9b7-403a-4d51-a6e7-f86e7312093d req-a1f4df29-dcad-48c8-a806-dcda753b7b18 service nova] Creating event network-vif-deleted:6dfc99bb-a56a-4062-b9d9-fa0c2c4b7292 for instance afeb9bbb-035f-454f-be46-f05542854e35 on hv-cinder-83699 Jun 03 16:18:14.705992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-71ccf9b7-403a-4d51-a6e7-f86e7312093d req-a1f4df29-dcad-48c8-a806-dcda753b7b18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036006 Jun 03 16:18:14.707027 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 224/457] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:18:14.725183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:14.734649 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-90f0b415-d732-4e94-85db-e12d77a3073e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.284191 Jun 03 16:18:14.735574 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 234/458] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:14 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:15.173651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:15.174351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:15.180492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:15.180941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:15.181698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:15.182133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:15.215847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:15.216359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:15.216813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lazy-loading 'fault' on Instance uuid afeb9bbb-035f-454f-be46-f05542854e35 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:18:15.261432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:15.269528 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6f09d5dc-8e34-4c1e-a69f-554124528112 tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1304 microversion: 2.1 time: 0.100486 Jun 03 16:18:15.270199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 225/459] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:15 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:15.751583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:15.752097 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:15.762110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:15.762874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:15.764178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:15.765067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:15.769709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:15.906088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:15.913524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-20b3870a-a96a-4d54-a083-9ae896487f64 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1521 microversion: 2.1 time: 0.165912 Jun 03 16:18:15.914109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 235/460] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:15 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:16.286882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:16.287515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:16.294336 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:16.294990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:16.295792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:16.296230 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:16.327093 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:16.327561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:16.328012 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lazy-loading 'fault' on Instance uuid afeb9bbb-035f-454f-be46-f05542854e35 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:18:16.366501 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334e442aa8d348beaa8dde1f78f5c68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09848a8d962b47439b233d1f06bf72e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:16.374369 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-da9b53dc-cfb7-4653-b3c9-2d6876cef84d tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 200 len: 1304 microversion: 2.1 time: 0.091179 Jun 03 16:18:16.374860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 226/461] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:16 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:16.929626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:16.930230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:16.936319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:16.936770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:16.937533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:16.937969 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:17.065945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:17.073734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-03121414-a62d-4956-bc74-eb3ec2f26351 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1501 microversion: 2.1 time: 0.147636 Jun 03 16:18:17.075785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 236/462] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:16 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:17.091891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:17.092511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:17.098508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:17.098952 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:17.099740 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:17.100351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:17.227465 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:17.234974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1ae44d01-f004-49ac-9097-d7d7fb83d9cc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1516 microversion: 2.1 time: 0.148217 Jun 03 16:18:17.235567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 227/463] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:17 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:17.390578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:17.391569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] [instance: afeb9bbb-035f-454f-be46-f05542854e35] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:17.398947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:17.399531 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:17.400420 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:17.400912 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:17.416100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] HTTP exception thrown: Instance afeb9bbb-035f-454f-be46-f05542854e35 could not be found. Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Request method failure captured: Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 HTTP/1.1 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjQu9eXpqSjD_1Mg3jE2ZGQWJ-l0SK_oEJOu9ZXsBqqug1JK3II0AolJeQgFdMXd8gOJ1WxjLt5UIYOnDpmu31Pn6E7XLzFgABDztqC-dGY4OwMZOfsOw-N5wFtGcFGp0eGX3uVfG01c3WI5rJy6YOFZlhqKa42OVYEHHbfYw9vsg00 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 09848a8d962b47439b233d1f06bf72e3 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesNegativeTest-272154869 Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:18:17.417752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/09848a8d962b47439b233d1f06bf72e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/09848a8d962b47439b233d1f06bf72e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/09848a8d962b47439b233d1f06bf72e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_09848a8d962b47439b233d1f06bf72e3"}]}] Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesNegativeTest-272154869 Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 09848a8d962b47439b233d1f06bf72e3 Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesNegativeTest-272154869 Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesNegativeTest-272154869-project Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 334e442aa8d348beaa8dde1f78f5c68d Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesNegativeTest-272154869-project Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance afeb9bbb-035f-454f-be46-f05542854e35 could not be found. Jun 03 16:18:17.419191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'afeb9bbb-035f-454f-be46-f05542854e35'} Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afeb9bbb-035f-454f-be46-f05542854e35 could not be found. Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:18:17.419974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afeb9bbb-035f-454f-be46-f05542854e35 could not be found. Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afeb9bbb-035f-454f-be46-f05542854e35 could not be found. Jun 03 16:18:17.421153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:18:17.422164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] Returning 404 to user: Instance afeb9bbb-035f-454f-be46-f05542854e35 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:18:17.422164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3e9363e4-7b53-4534-b69a-73a154f8d2cd tempest-VolumesNegativeTest-272154869 tempest-VolumesNegativeTest-272154869-project] 10.222.0.41 "GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35" status: 404 len: 111 microversion: 2.1 time: 0.033192 Jun 03 16:18:17.422164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 237/464] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:17 2022] GET /compute/v2.1/servers/afeb9bbb-035f-454f-be46-f05542854e35 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:18:20.696123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:20.697152 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:20.704204 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:20.704646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:20.705582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:20.706431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:20.730880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lazy-loading 'flavor' on Instance uuid 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:18:20.798646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-82ffcafb-6d0c-43f7-89ab-4dcd5b94c0d0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/action" status: 200 len: 32 microversion: 2.1 time: 0.106457 Jun 03 16:18:20.799285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 228/465] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:18:20 2022] POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/action => generated 32 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:18:20.808090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:20.808698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:20.810669 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:20.817146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:20.817596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:20.818483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:20.818918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:21.031659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:21.044124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-93aa45d3-9040-4234-ac19-b362bec2a866 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.239719 Jun 03 16:18:21.044886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 238/466] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:20 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:22.063559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:22.064262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:22.070353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:22.070857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:22.071594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:22.072031 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:22.206326 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:22.218830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6d0c0e15-cc91-486e-8b3b-b69edd734db7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.160111 Jun 03 16:18:22.219429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 229/467] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:22 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:18:23.237945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:23.238568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:23.246032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:23.246801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:23.248123 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:23.248749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:23.412786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:23.421906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f51b12fc-d986-42ba-bd83-aff24eede59c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.188041 Jun 03 16:18:23.422573 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 239/468] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:23 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:24.439364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:24.440011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:24.446857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:24.447357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:24.448139 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:24.448572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:24.621007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:24.630723 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-96beaf8f-3d24-406f-8801-37c99aafcbfd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.195332 Jun 03 16:18:24.631313 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 230/469] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:24 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:25.648715 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:25.649642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:25.658167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:25.658909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:25.659714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:25.660575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:25.870675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:25.882396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8b1a36d8-e7b0-4400-a96d-a0252ec735ea tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.237636 Jun 03 16:18:25.883228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 240/470] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:25 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:18:26.900209 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:26.901194 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:26.908890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:26.909349 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:26.910133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:26.910574 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:27.058119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:27.066659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e31a75d1-95d0-4d2f-9769-25a4c4bdcb3d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.170277 Jun 03 16:18:27.072423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 231/471] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:26 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:28.090399 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:28.091667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:28.098400 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:28.098850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:28.099648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:28.100086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:28.382913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:28.393173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-44e827ab-3f67-4993-8df8-e4558d92f682 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.306995 Jun 03 16:18:28.393848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 241/472] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:28 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:29.412439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:29.412439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:29.439977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:29.440427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:29.441216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:29.441649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:29.678881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:29.689981 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-888bdd70-b78a-4c4a-b9fe-db6c21a595b8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.280460 Jun 03 16:18:29.691717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 232/473] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:29 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:30.718725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:30.719394 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:30.734661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:30.738023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:30.739094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:30.739566 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:31.193012 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:31.203112 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0607fd6f-79ae-436e-8033-bc1146ee8e00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.499476 Jun 03 16:18:31.209919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 242/474] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:30 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:32.228559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:32.228559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:32.234571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:32.235057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:32.236173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:32.236682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:32.377257 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:32.388884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c26f1673-b84d-4e97-9372-9b72ea1b626d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Action: 'create', calling method: .version_select at 0x7fb5c16135e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-540010629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdgn4x3OY7MbYJbUZGLmw7bGCJfYyqkwAUUzq1R8HCWJxEMxnUBKpfrpiu73wPZCcGeVpYiaHAzQiAec+hz12ZXUJJ1lMx0A/PGGUIV/JL4AfhCHiP3ENrvUOjjSTvZzQ=="}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:32.390613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6ecc8d79-2936-46ec-95de-3c9f1086a1e6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.168335 Jun 03 16:18:32.400090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 243/475] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:32 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:32.400312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=50 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:32.410226 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-c26f1673-b84d-4e97-9372-9b72ea1b626d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:18:32.414336 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-c26f1673-b84d-4e97-9372-9b72ea1b626d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for user 331c97a12f1b4c2eb1eefa61056ce089 and project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:18:32.449890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c26f1673-b84d-4e97-9372-9b72ea1b626d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.275763 Jun 03 16:18:32.450564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 233/476] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:18:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:18:33.409743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:33.410375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:33.416974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:33.417434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:33.418447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:33.418896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:33.569428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:33.579128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bd72bda8-65b4-4473-a644-2fdc6c8f824a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.174798 Jun 03 16:18:33.580203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 244/477] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:33 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:34.598617 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:34.599338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:34.607978 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:34.608552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:34.610014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:34.610703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:34.782360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:34.790914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-999d9454-02f1-4030-b69e-b6cd3fc5eebf tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.197362 Jun 03 16:18:34.792077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 234/478] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:34 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:35.809094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:35.810351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:35.816974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:35.817423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:35.818204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:35.818825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:35.951633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:35.959273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d76e298c-2989-4a99-afb9-051d0e7a7a06 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.155032 Jun 03 16:18:35.959848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 245/479] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:35 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:36.976569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:36.977256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:36.986663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:36.987120 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:36.988207 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:36.988875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:36.994219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:37.142443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:37.152729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-05e9f1a5-84f0-4883-a742-4c78a1422067 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.180051 Jun 03 16:18:37.153305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 235/480] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:36 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:38.169904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:38.170413 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:38.176674 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:38.177117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:38.177875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:38.178307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:38.313545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:38.321257 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a5349949-5970-4020-857b-f7ee39eb0d35 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.155264 Jun 03 16:18:38.321816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 246/481] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:38 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:39.338008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:39.338562 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:39.345471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:39.345916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:39.346696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:39.347123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:39.475242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:39.487180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-037d6d15-571b-429d-9a44-d99f2c749a68 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.153041 Jun 03 16:18:39.487875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 236/482] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:39 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:40.505451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:40.506063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:40.512815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:40.513282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:40.514117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:40.514760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:40.649150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:40.657445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-26d82736-6be5-4ce6-b870-056bcfa39edd tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.155823 Jun 03 16:18:40.658003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 247/483] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:40 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:41.674090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:41.674706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:41.681343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:41.681800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:41.682576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:41.683017 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:41.818477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:41.826144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bdbbaa2e-1e3f-4426-acb8-80fa9e4b755a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.155988 Jun 03 16:18:41.826715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 237/484] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:41 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:42.844035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:42.844778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:42.851142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:42.851701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:42.852573 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:42.853129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:42.992682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:43.000263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f47c2695-4880-47e5-95be-53c17ca46b10 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1502 microversion: 2.1 time: 0.161107 Jun 03 16:18:43.000839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 248/485] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:42 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:43.016653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37c69bd8-aba9-4bba-bea8-11a9a56b26a9"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:43.017825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:43.019748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=4 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:43.026364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:43.027343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:43.028143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:43.028584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:43.052108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] HTTP exception thrown: Cannot 'attach_volume' instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 while it is in vm_state rescued Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Request method failure captured: Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/os-volume_attachments HTTP/1.1 Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 74 Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO8CvWPyoGUGP7589mDfybb0r4x4SIfyl7oWrTkzfwNMVxJ7YY4L7okSJ02orQcqE8viW_VKf4NFF1cBpsNksHfWkEQkayTtL_IkXahuioGHODuDL3RAH7U6m7Q3fq_LgXhmBUPe5Yfc6LwvahIygeKT0ma-hZUV8Mpyy_dVOHpRiA Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:18:43.054332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1443b802dc724950b5eb5c6446e2515c"}]}] Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 4206a21c317e4b5aace8541699f8032d Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {"volumeAttachment": {"volumeId": "37c69bd8-aba9-4bba-bea8-11a9a56b26a9"}} Jun 03 16:18:43.055953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Cannot 'attach_volume' instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 while it is in vm_state rescued Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'server_id': '4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03', 'body': {'volumeAttachment': {'volumeId': '37c69bd8-aba9-4bba-bea8-11a9a56b26a9'}}} Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:18:43.060813 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 while it is in vm_state rescued Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:18:43.062081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 while it is in vm_state rescued Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Returning 409 to user: Cannot 'attach_volume' instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 while it is in vm_state rescued {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a188592d-5353-4dd9-b0f2-a84c233ce1a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043205 Jun 03 16:18:43.063231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 238/486] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:18:43 2022] POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 16:18:43.065189 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:43.065801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:43.071928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:43.072386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:43.073168 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:43.073611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:43.145783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7d02b94d-d097-40b7-8d3b-11c002dcdc82 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/action" status: 202 len: 0 microversion: 2.1 time: 0.084232 Jun 03 16:18:43.146440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 249/487] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:18:43 2022] POST /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:18:43.155645 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:43.156533 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:43.162844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:43.163322 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:43.164295 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:43.164948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:43.314293 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:43.327618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ffe4ddb7-0938-4a0a-807e-b93252163b27 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1510 microversion: 2.1 time: 0.175728 Jun 03 16:18:43.328600 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 239/488] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:43 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:44.347077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:44.347913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:44.357801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:44.358418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:44.359198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:44.360213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:44.503976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:44.512284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5f426b76-ea71-4f11-86b2-230e396ae26d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1510 microversion: 2.1 time: 0.169410 Jun 03 16:18:44.512891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 250/489] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:44 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:45.530983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:45.532220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:45.541673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:45.542133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:45.542960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:45.543432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:45.689865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:45.698177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0be3dc61-e7a0-4218-99ad-81e9480947d4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1510 microversion: 2.1 time: 0.171747 Jun 03 16:18:45.708728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 240/490] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:45 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:46.716046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:46.716586 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:46.722551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:46.723005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:46.723808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:46.724253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:46.727113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:46.853281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:46.861057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-49de51fe-121b-4d4a-a36a-6283c32e6463 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1510 microversion: 2.1 time: 0.149009 Jun 03 16:18:46.862236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 251/491] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:46 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:47.879082 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:47.879726 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:47.886601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:47.887062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:47.887877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:47.888299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:47.995631 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2007782943", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "networks": [{"uuid": "018ab0be-ad68-404f-ba6e-516f8e1af734"}]}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:48.038624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:48.046265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-dc9dc560-5a54-4fc0-a60a-fcbc3d2404eb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1510 microversion: 2.1 time: 0.171078 Jun 03 16:18:48.046394 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] validate_networks() for [('018ab0be-ad68-404f-ba6e-516f8e1af734', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:18:48.046825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 241/492] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:47 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:48.395539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:18:48.395965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:18:48.396557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:18:48.396968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:18:48.397379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:18:48.406655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:48.407101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:48.407952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:48.408503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:48.426891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Getting quotas for project 1b5c201aae5e438c81d8976289ffb4cb. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:18:48.430788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Getting quotas for user 12a595db7f394c7e86b6a9e0c9f625f8 and project 1b5c201aae5e438c81d8976289ffb4cb. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:18:48.442135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:18:48.444438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:18:48.487898 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-04bce082-9f95-44d8-9607-72e0703f0ac1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496046 Jun 03 16:18:48.489144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 252/493] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:18:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 16:18:48.499833 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0b53e438-d91d-49c6-8888-46dbaf6eb34a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:48.500706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0b53e438-d91d-49c6-8888-46dbaf6eb34a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:48.559397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0b53e438-d91d-49c6-8888-46dbaf6eb34a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:48.578668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0b53e438-d91d-49c6-8888-46dbaf6eb34a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1219 microversion: 2.1 time: 0.083239 Jun 03 16:18:48.580682 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 242/494] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:48 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:49.064327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:49.065044 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:49.074418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:49.075056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:49.076602 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:49.077107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:49.230925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:49.240645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-50e35c07-d8a1-4c2f-a992-90d6176fdc96 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1516 microversion: 2.1 time: 0.180384 Jun 03 16:18:49.241516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 253/495] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:49 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:49.596997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:49.597611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:49.604056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:49.604506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:49.606024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:49.606466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:49.680691 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:49.688223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2d928905-6087-4e85-9a3c-1f56abb18794 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1271 microversion: 2.1 time: 0.095069 Jun 03 16:18:49.689165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 243/496] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:49 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:50.707742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:50.711622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:50.724725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:50.726215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:50.727550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:50.728634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:51.128417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:51.136525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b0fca67f-7944-4923-866a-95c1774d1be8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.434333 Jun 03 16:18:51.137188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 254/497] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:50 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:51.701538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2373605d-a119-465f-b6fc-f86b56cc1895 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'create', calling method: .version_select at 0x7fb5c16d9af0>, body: {"keypair": {"name": "tempest-keypair-525613816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJn7KDhynJ9ZgLSeRTAUpGqveGOCD0Mwk09LPum8I5bQ0CrXIVAetUfC0Qua2ZUbokXhDrmStFjkfNv36M3k9V0gGkbZzUlpPTWhmPj1nxfnMRRUx/fwgPeD2w1LtDFIA=="}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:51.717375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-2373605d-a119-465f-b6fc-f86b56cc1895 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for project 1443b802dc724950b5eb5c6446e2515c. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:18:51.723169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-2373605d-a119-465f-b6fc-f86b56cc1895 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for user 4206a21c317e4b5aace8541699f8032d and project 1443b802dc724950b5eb5c6446e2515c. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:18:51.732823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-ac97bb90-7481-4b38-a70b-d959476ea1b8 req-0ac062ac-ef34-4a35-a136-ef0c4c22d4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1a049c-1161-4126-8866-62c500132dd0", "tag": "0a0da5af-7964-4f97-92ed-782676453f7c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:51.737597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:18:51.764286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2373605d-a119-465f-b6fc-f86b56cc1895 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067059 Jun 03 16:18:51.765604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 244/498] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:18:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:18:51.770661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-ac97bb90-7481-4b38-a70b-d959476ea1b8 req-0ac062ac-ef34-4a35-a136-ef0c4c22d4e4 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:51.770661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-ac97bb90-7481-4b38-a70b-d959476ea1b8 req-0ac062ac-ef34-4a35-a136-ef0c4c22d4e4 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:51.793171 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-ac97bb90-7481-4b38-a70b-d959476ea1b8 req-0ac062ac-ef34-4a35-a136-ef0c4c22d4e4 service nova] Creating event network-changed:0a0da5af-7964-4f97-92ed-782676453f7c for instance 0a1a049c-1161-4126-8866-62c500132dd0 on hv-cinder-83699 Jun 03 16:18:51.800097 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-ac97bb90-7481-4b38-a70b-d959476ea1b8 req-0ac062ac-ef34-4a35-a136-ef0c4c22d4e4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070917 Jun 03 16:18:51.804001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 255/499] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:18:52.155125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:52.155867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:52.163991 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:52.164723 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:52.166329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:52.167475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:52.401572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:52.409403 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5b5a9f7e-a3d0-415e-ab32-245e3d511dba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.258939 Jun 03 16:18:52.410041 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 245/500] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:52 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:53.392211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-359249214", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e0aaf95-4836-425b-942f-acfb7d3ce506"}], "security_groups": [{"name": "tempest-securitygroup--2101243888"}], "key_name": "tempest-keypair-525613816", "user_data": "}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:53.393068 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-935939289", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "networks": [{"uuid": "4e1b45b4-00b2-4d69-b755-1aadb142f456"}]}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:53.443696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] validate_networks() for [('4e1b45b4-00b2-4d69-b755-1aadb142f456', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:18:53.492841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] validate_networks() for [('6e0aaf95-4836-425b-942f-acfb7d3ce506', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:18:53.782429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:18:53.782930 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:18:53.783519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:18:53.784001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:18:53.784547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:18:53.794033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:53.794479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:53.795274 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:53.795743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:53.812745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Getting quotas for project 573ee03c74e3443d8a8d5e5568507d37. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:18:53.816814 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Getting quotas for user 196748d4d1744c2d9fc441ea3a061dd9 and project 573ee03c74e3443d8a8d5e5568507d37. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:18:53.827860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:18:53.830117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:18:53.861573 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:18:53.862119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:18:53.862642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:18:53.863030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:18:53.863477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:18:53.873539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:53.873987 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:53.874786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:53.875452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:53.877476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [4e34282f-bdb6-4fc3-8a4a-a0b16ab5ee2c] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 16:18:53.892926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for project 1443b802dc724950b5eb5c6446e2515c. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:18:53.896950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Getting quotas for user 4206a21c317e4b5aace8541699f8032d and project 1443b802dc724950b5eb5c6446e2515c. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:18:53.908453 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:18:53.910847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:18:53.958969 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f8807c05-a109-4c49-be00-d8365014f4e2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.571445 Jun 03 16:18:53.959651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 256/501] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:18:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 16:18:53.964725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:53.965331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:53.971565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:53.972012 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:53.972774 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:53.973206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:54.111594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:54.119344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b6dcfcb5-a27d-422d-8403-eaa15142f288 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.158682 Jun 03 16:18:54.120015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 257/502] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:53 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:54.130458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1121456e-3015-4d2a-bf65-75451909f641 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:54.131235 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1121456e-3015-4d2a-bf65-75451909f641 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:54.185164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1121456e-3015-4d2a-bf65-75451909f641 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:54.192180 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1121456e-3015-4d2a-bf65-75451909f641 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1244 microversion: 2.1 time: 0.071010 Jun 03 16:18:54.192737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 258/503] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:54 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:54.884544 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [4e34282f-bdb6-4fc3-8a4a-a0b16ab5ee2c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 57970. Jun 03 16:18:54.888647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-735b02e8-4e2c-4d4a-9f1f-f99fd5de6d29 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499433 Jun 03 16:18:54.889306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 246/504] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 16:18:54.899189 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-37e49445-440f-44c2-bb6d-c35ee6da72e6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:54.899861 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-37e49445-440f-44c2-bb6d-c35ee6da72e6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:54.957742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-37e49445-440f-44c2-bb6d-c35ee6da72e6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:54.966320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-37e49445-440f-44c2-bb6d-c35ee6da72e6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1213 microversion: 2.1 time: 0.071052 Jun 03 16:18:54.966887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 259/505] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:54 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:55.136904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:55.137633 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:55.144350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:55.145061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:55.145826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:55.146260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:55.209873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:55.210484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:55.217611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:55.218272 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:55.219050 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:55.219682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:55.292651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:55.296258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:55.300551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7a8dfa25-7d43-43db-a2f0-0852ab67a9d3 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.168041 Jun 03 16:18:55.301119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 247/506] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:55 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:55.303936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0889838f-95b3-475a-89fd-09eaf4501eb3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1248 microversion: 2.1 time: 0.097841 Jun 03 16:18:55.304474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 260/507] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:55 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1248 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:55.983611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:55.984357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:55.990969 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:55.991387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:55.992159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:55.992598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:56.052785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:56.060280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9c60b5bf-35f9-41f9-833e-31f95fa0f6fb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1217 microversion: 2.1 time: 0.080837 Jun 03 16:18:56.060836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 248/508] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:55 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:56.317028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:56.317671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:56.320619 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:56.321232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:56.324308 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:56.324768 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:56.325518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:56.325949 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:56.327712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:56.328234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:56.328912 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:56.329343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:56.388263 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:56.395817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-31a7b9fa-f45d-49f4-9789-39c89f52bace tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1248 microversion: 2.1 time: 0.079131 Jun 03 16:18:56.396391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 249/509] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:56 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:18:56.450642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:56.457925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c63ca33b-dc8b-40b5-8f32-c11899c7b193 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.144747 Jun 03 16:18:56.458475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 261/510] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:56 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:57.077682 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:57.078506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:57.086674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:57.087127 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:57.087928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:57.088362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:57.149163 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:57.157357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2e9c37f0-d319-46aa-99f9-1bfec7be02d1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1217 microversion: 2.1 time: 0.084648 Jun 03 16:18:57.157907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 250/511] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:57 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:57.412857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:57.413374 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:57.420040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:57.420484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:57.421245 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:57.421675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:57.473880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:57.474487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:57.480448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:57.480893 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:57.481042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:57.481653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:57.482088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:57.488375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-06512206-d07a-4848-8ad4-0ecc96df7996 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1248 microversion: 2.1 time: 0.079470 Jun 03 16:18:57.488936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 262/512] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:57 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1248 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:57.611626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:57.618909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-63de424d-6b73-44ac-b73f-63b9fdfbab29 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.148853 Jun 03 16:18:57.619489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 251/513] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:57 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:18:58.173850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:58.174465 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:58.180538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.180989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.181756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.182193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.244649 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:58.253185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ff31b66a-c511-4862-9b02-a59afa12164b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1265 microversion: 2.1 time: 0.082872 Jun 03 16:18:58.254150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 263/514] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:58 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:58.504738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:58.505360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:58.512119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.512575 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.513340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.513780 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.573436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:58.581305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-79384192-e7f0-47ad-a94a-6297634a18c0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1296 microversion: 2.1 time: 0.080639 Jun 03 16:18:58.581909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 252/515] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:58 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:58.636154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:58.636781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:58.644029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.644396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.645198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.645634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.761582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-2cfa6d70-e5cf-4a42-8cac-bdb1248b8610 req-61f47522-0f23-4af9-85b8-021bec76bc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1a049c-1161-4126-8866-62c500132dd0", "name": "network-vif-plugged", "status": "completed", "tag": "0a0da5af-7964-4f97-92ed-782676453f7c"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:18:58.773772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-2cfa6d70-e5cf-4a42-8cac-bdb1248b8610 req-61f47522-0f23-4af9-85b8-021bec76bc7d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:58.774702 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-2cfa6d70-e5cf-4a42-8cac-bdb1248b8610 req-61f47522-0f23-4af9-85b8-021bec76bc7d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:58.788977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-2cfa6d70-e5cf-4a42-8cac-bdb1248b8610 req-61f47522-0f23-4af9-85b8-021bec76bc7d service nova] Creating event network-vif-plugged:0a0da5af-7964-4f97-92ed-782676453f7c for instance 0a1a049c-1161-4126-8866-62c500132dd0 on hv-cinder-83699 Jun 03 16:18:58.795747 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-2cfa6d70-e5cf-4a42-8cac-bdb1248b8610 req-61f47522-0f23-4af9-85b8-021bec76bc7d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043801 Jun 03 16:18:58.797145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 253/516] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:18:58.838795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:58.853389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dbd8dd3e-4a9f-42dd-9928-d00d5310761f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.220913 Jun 03 16:18:58.855218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 264/517] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:58 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:59.270506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:59.271268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:59.278580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:59.279111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:59.280114 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:59.280673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:59.353573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:59.360992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-08a068aa-511e-4fc4-a0ef-61d81666b33a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1271 microversion: 2.1 time: 0.094761 Jun 03 16:18:59.361624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 254/518] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:59 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:59.597747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:59.598360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:59.604406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:59.604853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:59.605640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:59.606072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:59.673769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:18:59.681382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d784b0dd-0025-488e-bfe8-5165feb88e71 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1302 microversion: 2.1 time: 0.087440 Jun 03 16:18:59.681940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 265/519] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:59 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:18:59.871748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:18:59.872497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:18:59.878917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:59.879408 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:59.880188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:18:59.880632 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:18:59.895337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:00.087627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:00.095558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fa9a1cbe-ed48-486a-9ad2-2e881f163dbe tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.228256 Jun 03 16:19:00.096135 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 255/520] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:18:59 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:00.377907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:00.378562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:00.384720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:00.385247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:00.385994 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:00.386423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:00.512016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:00.519339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e1c0e462-ce16-431d-81d6-7fe1742b715e tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.145294 Jun 03 16:19:00.519894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 266/521] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:00 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:00.699807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:00.700424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:00.706376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:00.706826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:00.707688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:00.708123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:01.102482 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:01.111934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-91eed973-d28d-4813-8325-0f431ae9f7bb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.416482 Jun 03 16:19:01.112586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 256/522] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:00 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:01.113099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:01.113882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:01.123683 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:01.124142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:01.124917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:01.125356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:01.262223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:01.270088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-627d37a4-3f06-4465-bb4c-3951cb42de5a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1319 microversion: 2.1 time: 0.161001 Jun 03 16:19:01.271203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 267/523] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:01 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:01.536574 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:01.537392 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:01.544354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:01.545104 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:01.546003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:01.546672 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:01.950031 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:01.957566 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c0f97121-7a7a-43bd-954c-5b6a069416db tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.424908 Jun 03 16:19:01.958174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 257/524] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:01 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:02.130033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:02.130720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:02.142561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-b9080341-0a4e-4c59-9891-4a874769e900 req-f4fedf93-553d-4373-827e-defd16fe68de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dd4532-b480-4825-bdb7-92dfdbee664e", "tag": "8fc54159-dadd-4320-92b7-a2e941f93336"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:02.145021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.145463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:02.146243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.146860 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:02.165527 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-b9080341-0a4e-4c59-9891-4a874769e900 req-f4fedf93-553d-4373-827e-defd16fe68de service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.166014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-b9080341-0a4e-4c59-9891-4a874769e900 req-f4fedf93-553d-4373-827e-defd16fe68de service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:02.189745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-b9080341-0a4e-4c59-9891-4a874769e900 req-f4fedf93-553d-4373-827e-defd16fe68de service nova] Creating event network-changed:8fc54159-dadd-4320-92b7-a2e941f93336 for instance 48dd4532-b480-4825-bdb7-92dfdbee664e on hv-cinder-83699 Jun 03 16:19:02.195151 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-b9080341-0a4e-4c59-9891-4a874769e900 req-f4fedf93-553d-4373-827e-defd16fe68de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058353 Jun 03 16:19:02.196284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 258/525] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:02.288386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:02.289339 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:02.297743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.298490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:02.299486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.300082 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:02.323998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:02.331930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3055da72-469d-46b0-8e17-41a17a5b4862 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.206343 Jun 03 16:19:02.332504 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 268/526] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:02 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:02.599397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:02.606892 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-19098154-a443-4dd2-82d0-5c2ca58e7538 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1508 microversion: 2.1 time: 0.322930 Jun 03 16:19:02.607698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 259/527] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:02 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:02.973778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:02.974409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:02.981392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.981857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:02.982648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:02.983095 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:03.124731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:03.132427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9751c892-a60b-4373-bed0-3cfca1ec7603 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.162452 Jun 03 16:19:03.132998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 269/528] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:02 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:03.348469 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:03.349174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:03.351858 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:03.357376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:03.357904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:03.358760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:03.359205 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:03.507931 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:03.515231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d141189f-5820-411c-902a-f0dfa5a906f0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.170681 Jun 03 16:19:03.515830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 260/529] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:03 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:03.584513 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-119736219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-540010629", "security_groups": [{"name": "tempest-secgroup-smoke-604653336"}], "block_device_mapping_v2": [{"uuid": "729e135d-74cb-41f9-912d-fe4558733be0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6170e7ad-2948-49aa-8d76-bb5733efca78"}]}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:03.712106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] validate_networks() for [('6170e7ad-2948-49aa-8d76-bb5733efca78', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:19:03.885509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=4 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:04.084236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:19:04.084236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:19:04.084236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:19:04.084236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:19:04.084236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:19:04.086572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.087362 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.088037 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.089008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.106017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:19:04.109951 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for user 331c97a12f1b4c2eb1eefa61056ce089 and project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:19:04.149809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:04.150737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:04.153129 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:04.154014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=12 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:04.159979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.160435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.161211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.161648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.170813 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:19:04.173043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='729e135d-74cb-41f9-912d-fe4558733be0',volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:19:04.311145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:04.320548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-50d45e70-30b7-4cc0-a6a9-2ad0e15d693c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.174524 Jun 03 16:19:04.321902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 261/530] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:04 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:04.324021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fb881efa-a2b3-45b1-8692-e1620a44d42b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.743024 Jun 03 16:19:04.325079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 270/531] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:19:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:19:04.327967 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-8d7959a0-18b1-4190-9975-32f120de2f2d req-2b722240-3baa-47ca-b830-2be582659d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b7d211-5b5b-4d26-aa96-cb295c20451d", "tag": "00ec2058-4aa7-4f71-a6fa-0278283989c0"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:04.337259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-8d7959a0-18b1-4190-9975-32f120de2f2d req-2b722240-3baa-47ca-b830-2be582659d6c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.337716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-8d7959a0-18b1-4190-9975-32f120de2f2d req-2b722240-3baa-47ca-b830-2be582659d6c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.341929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1c7dc21a-7d4d-4db3-86e0-fad460c18630 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:04.342843 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1c7dc21a-7d4d-4db3-86e0-fad460c18630 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:04.350708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-8d7959a0-18b1-4190-9975-32f120de2f2d req-2b722240-3baa-47ca-b830-2be582659d6c service nova] Creating event network-changed:00ec2058-4aa7-4f71-a6fa-0278283989c0 for instance 58b7d211-5b5b-4d26-aa96-cb295c20451d on hv-cinder-83699 Jun 03 16:19:04.355879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-8d7959a0-18b1-4190-9975-32f120de2f2d req-2b722240-3baa-47ca-b830-2be582659d6c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032578 Jun 03 16:19:04.356465 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 262/532] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:04.399203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1c7dc21a-7d4d-4db3-86e0-fad460c18630 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:04.406763 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1c7dc21a-7d4d-4db3-86e0-fad460c18630 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1093 microversion: 2.1 time: 0.070284 Jun 03 16:19:04.407534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 271/533] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:04 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:04.534031 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:04.534769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:04.540973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.541419 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.542217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:04.542650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:04.679693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:04.688326 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-051d7432-97cc-4bff-92a3-68ef1d607b2e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.159309 Jun 03 16:19:04.688894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 263/534] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:04 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:05.341022 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:05.342067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:05.349195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:05.349642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:05.350417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:05.350851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:05.423835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:05.424491 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:05.431201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:05.431678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:05.432474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:05.432907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:05.480467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:05.488046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-81b6ad6e-b766-4fe9-b6be-86e4e3a2e2b0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.152982 Jun 03 16:19:05.488605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 272/535] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:05 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:05.493034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:05.500300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-46e4f2ab-27fc-4fbe-83f7-27e4b3e3620d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1143 microversion: 2.1 time: 0.080308 Jun 03 16:19:05.500855 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 264/536] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:05 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:05.706954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:05.707626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:05.713643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:05.714734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:05.715519 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:05.715952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:05.730380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:05.842227 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:05.851252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6f74ea64-e3da-47eb-acbe-b67ee6c96fc2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.147961 Jun 03 16:19:05.851864 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 273/537] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:05 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:06.504242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:06.504852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:06.511311 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:06.511868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:06.512633 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:06.513077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:06.516559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:06.517176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:06.523096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:06.523595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:06.524368 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:06.524808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:06.582493 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:06.589977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e31e9821-8721-4e57-a3e3-da90248ac7eb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1143 microversion: 2.1 time: 0.077239 Jun 03 16:19:06.590536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 274/538] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:06 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1143 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:06.665983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:06.674125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4471bf68-7dd3-4999-b698-7af9a647c2eb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.173694 Jun 03 16:19:06.674696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 265/539] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:06 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:06.868678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:06.869287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:06.875248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:06.875723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:06.876482 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:06.876914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:07.003102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:07.010605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-055394a4-ad7c-4b0b-997b-848e4cdd1886 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.145650 Jun 03 16:19:07.011207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 275/540] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:06 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:07.606014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:07.606792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:07.613228 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:07.613678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:07.614446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:07.614885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:07.676936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:07.685067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-36bf40ad-bfdf-43e7-9a20-e006e1e1d361 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1143 microversion: 2.1 time: 0.082846 Jun 03 16:19:07.689019 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 266/541] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:07 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:07.698370 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:07.699541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:07.705679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:07.706136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:07.706910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:07.707374 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:07.830670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:07.837968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5a397e23-df3f-4ba1-b812-6c71e2f0106b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.151645 Jun 03 16:19:07.838529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 276/542] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:07 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:08.028262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:08.028879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:08.034801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:08.035254 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:08.036050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:08.036498 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:08.171317 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:08.178753 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-77314728-2272-4cf2-9a8f-91edbaa73dbc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.154713 Jun 03 16:19:08.179318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 267/543] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:08 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:08.705234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:08.705846 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:08.711887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:08.712341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:08.713108 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:08.713546 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:08.776464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:08.784579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-43cecdba-6a2a-4e5c-8dbc-2bbc3e28dfcf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1143 microversion: 2.1 time: 0.083187 Jun 03 16:19:08.785131 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 277/544] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:08 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:08.854560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:08.855204 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:08.861611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:08.862061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:08.862821 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:08.863256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:09.000213 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:09.007462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e7c4d53e-dfe2-44e8-a6dc-e32bc4c6ee54 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.156650 Jun 03 16:19:09.008023 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 268/545] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:08 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:09.195935 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:09.196550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:09.203208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:09.203692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:09.204472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:09.204910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:09.351041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:09.359184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ffa4596e-ccfc-43ba-ae0e-5ca4eb25be74 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.167029 Jun 03 16:19:09.359824 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 278/546] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:09 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:09.374293 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-61ffa0c9-bd5c-4cc4-820a-9928749f745c req-a8ca076e-fbbf-4d27-83ef-efcfb8b35450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd4532-b480-4825-bdb7-92dfdbee664e", "name": "network-vif-plugged", "status": "completed", "tag": "8fc54159-dadd-4320-92b7-a2e941f93336"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:09.382792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-61ffa0c9-bd5c-4cc4-820a-9928749f745c req-a8ca076e-fbbf-4d27-83ef-efcfb8b35450 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:09.383246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-61ffa0c9-bd5c-4cc4-820a-9928749f745c req-a8ca076e-fbbf-4d27-83ef-efcfb8b35450 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:09.394286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-61ffa0c9-bd5c-4cc4-820a-9928749f745c req-a8ca076e-fbbf-4d27-83ef-efcfb8b35450 service nova] Creating event network-vif-plugged:8fc54159-dadd-4320-92b7-a2e941f93336 for instance 48dd4532-b480-4825-bdb7-92dfdbee664e on hv-cinder-83699 Jun 03 16:19:09.399216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-61ffa0c9-bd5c-4cc4-820a-9928749f745c req-a8ca076e-fbbf-4d27-83ef-efcfb8b35450 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029261 Jun 03 16:19:09.400256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 269/547] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:09.801417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:09.802028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:09.808065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:09.808568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:09.809339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:09.810307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:09.867378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:09.875072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-40b37a2f-f2bd-409b-b98c-6ffeab0c1934 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1143 microversion: 2.1 time: 0.077532 Jun 03 16:19:09.875668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 279/548] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:09 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1143 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:10.026542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:10.027339 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:10.034978 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:10.035512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:10.036395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:10.037020 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:10.170063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:10.177468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-566a4b56-e311-42d9-9604-ebc8f8d082f0 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.156246 Jun 03 16:19:10.178042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 270/549] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:10 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:10.376914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:10.377518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:10.383577 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:10.384035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:10.384834 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:10.385278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:10.485755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:19:10.485985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d (ip 10.222.0.41) !!! Jun 03 16:19:10.514749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:10.522144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e723c834-4736-4e3d-8266-0a899e5045ab tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.149083 Jun 03 16:19:10.522705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 280/550] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:10 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:10.892867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:10.893587 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:10.899561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:10.900415 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:10.901183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:10.901624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:10.962323 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:10.970288 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-df0ded93-d87a-49a1-9467-6061f221299b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1191 microversion: 2.1 time: 0.082691 Jun 03 16:19:10.970846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 271/551] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:10 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1191 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:11.194118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:11.194738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:11.201212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:11.201659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:11.202424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:11.202855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:11.332278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:11.339574 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-34831743-7669-4eab-b7c2-db042b794b22 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.149500 Jun 03 16:19:11.340146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 281/552] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:11 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:11.539845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:11.541187 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:11.548289 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:11.549113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:11.550011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:11.550640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:11.743721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:11.751990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d66944a4-ebc7-4f18-bd9f-a646dc39cab8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.216588 Jun 03 16:19:11.752547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 272/553] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:11 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:11.988689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:11.989721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:11.996446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:11.996916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:11.997694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:11.998126 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:12.057947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:12.065476 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7bca5a15-d99e-4510-a57c-1deb56441ce9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1209 microversion: 2.1 time: 0.081167 Jun 03 16:19:12.066070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 282/554] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:11 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:12.357035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:12.357673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:12.363623 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:12.364064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:12.364820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:12.365250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:12.493846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:12.501971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-064cfa6d-cc60-4d38-9bc8-d821ac5ef43c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1313 microversion: 2.1 time: 0.149310 Jun 03 16:19:12.502530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 273/555] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:12 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:12.769028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:12.769862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:12.777234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:12.778643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:12.779601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:12.780284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:13.009233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:13.019211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d066fc63-bcdb-4718-a3f0-fbb9368a6f28 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.253872 Jun 03 16:19:13.020302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 283/556] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:12 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:13.083270 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:13.083968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:13.092129 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:13.092847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:13.093511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:13.094090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:13.097274 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:13.374298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:13.381693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b78c840e-3403-45c9-ab26-2553de791ba8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1276 microversion: 2.1 time: 0.303143 Jun 03 16:19:13.382251 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 274/557] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:13 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:13.523100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:13.523887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:13.531176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:13.531647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:13.532424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:13.532859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:13.657231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:13.664536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cb520c8d-82a4-4e00-8557-524b4aa9f45a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1496 microversion: 2.1 time: 0.145690 Jun 03 16:19:13.665350 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 284/558] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:13 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1496 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:13.983753 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-82cf8f3f-becf-4451-a849-914522ae10c3 req-e2ddb75b-ab39-47cf-b50a-ed4947158b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b7d211-5b5b-4d26-aa96-cb295c20451d", "name": "network-vif-plugged", "status": "completed", "tag": "00ec2058-4aa7-4f71-a6fa-0278283989c0"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:13.994089 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-82cf8f3f-becf-4451-a849-914522ae10c3 req-e2ddb75b-ab39-47cf-b50a-ed4947158b3d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:13.994576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-82cf8f3f-becf-4451-a849-914522ae10c3 req-e2ddb75b-ab39-47cf-b50a-ed4947158b3d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.006670 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-82cf8f3f-becf-4451-a849-914522ae10c3 req-e2ddb75b-ab39-47cf-b50a-ed4947158b3d service nova] Creating event network-vif-plugged:00ec2058-4aa7-4f71-a6fa-0278283989c0 for instance 58b7d211-5b5b-4d26-aa96-cb295c20451d on hv-cinder-83699 Jun 03 16:19:14.011383 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-82cf8f3f-becf-4451-a849-914522ae10c3 req-e2ddb75b-ab39-47cf-b50a-ed4947158b3d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031337 Jun 03 16:19:14.011966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 275/559] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:14.041437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:14.049080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:14.064365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.064834 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.065594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.066047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.097212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:14.171735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:14.172911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:14.181407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.182091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.183175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.183704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.213278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:19:14.302988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-89ba61a1-d65f-449c-997f-63212c6069e5 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "DELETE /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 204 len: 0 microversion: 2.1 time: 0.136624 Jun 03 16:19:14.305099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 276/560] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:19:14 2022] DELETE /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 16:19:14.315423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:14.316935 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:14.328265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.329130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.330524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.331180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.339964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:14.352823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cd347da6-357f-4714-bf06-b2b4d6f7153c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.315218 Jun 03 16:19:14.353399 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 285/561] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:14 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:14.397948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:14.398855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:14.401166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:14.404625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=24 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:14.410281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.410727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.411566 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.412175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.473480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:14.480959 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7278c13b-a74c-469d-95fa-698486f3ae49 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1502 microversion: 2.1 time: 0.171327 Jun 03 16:19:14.481566 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 277/562] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:14 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:14.595035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:14.602772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-813a837d-531c-4c81-ae0e-9aca08999ff4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.208627 Jun 03 16:19:14.603396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 286/563] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:14 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:14.892736 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-178ac025-7044-4ace-913b-2d119c1ca974 req-18479426-ba27-4abd-8dd0-06e020becfbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea2cd56-026c-4b2e-a39a-35bc5db65f46", "tag": "373d5130-e651-4986-b65f-2e89d25c7140"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:14.901368 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-178ac025-7044-4ace-913b-2d119c1ca974 req-18479426-ba27-4abd-8dd0-06e020becfbf service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:14.902312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-178ac025-7044-4ace-913b-2d119c1ca974 req-18479426-ba27-4abd-8dd0-06e020becfbf service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:14.920614 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-178ac025-7044-4ace-913b-2d119c1ca974 req-18479426-ba27-4abd-8dd0-06e020becfbf service nova] Creating event network-changed:373d5130-e651-4986-b65f-2e89d25c7140 for instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 on hv-cinder-83699 Jun 03 16:19:14.925861 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-178ac025-7044-4ace-913b-2d119c1ca974 req-18479426-ba27-4abd-8dd0-06e020becfbf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038531 Jun 03 16:19:14.926469 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 278/564] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:15.369661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:15.370269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:15.377057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:15.377506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:15.378265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:15.378699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:15.499367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:15.500074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:15.506234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:15.506629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:15.507428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:15.507874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:15.512415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:15.519838 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-41d3502c-2db0-42bf-9351-b5faeeb63b81 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.153960 Jun 03 16:19:15.520406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 287/565] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:15 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:15.620104 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:15.620800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:15.627708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:15.628157 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:15.628921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:15.629356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:15.643810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:15.651473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-851f1f3a-533b-4efc-94ed-a0016184c2ba tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1502 microversion: 2.1 time: 0.157262 Jun 03 16:19:15.652039 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 279/566] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:15 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:15.793007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:15.801142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cb8049a7-fd53-4ba5-9227-bb8da706f8dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.184822 Jun 03 16:19:15.801698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 288/567] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:15 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:16.536959 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:16.537664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:16.544367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:16.544812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:16.545582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:16.546013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:16.668122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:16.668821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:16.674890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:16.675363 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:16.676132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:16.676566 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:16.692697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:16.700820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-52774401-7560-4c85-9f93-6ce06f072b59 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.167073 Jun 03 16:19:16.701378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 280/568] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:16 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:16.803515 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:16.811397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5757aacc-f7fc-4ece-876b-2a7172e23b1f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1502 microversion: 2.1 time: 0.147089 Jun 03 16:19:16.811967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 289/569] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:16 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:16.817479 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:16.818096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:16.824067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:16.824516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:16.825926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:16.826374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:16.952251 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:16.959623 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-81ee1dbc-b404-4b6f-8999-60e8eec26106 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.145936 Jun 03 16:19:16.960189 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 281/570] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:16 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:17.571030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-4de75ba6-d05c-4f19-bc03-b5c130819e6e req-4804ce84-d70c-4ab0-8eb0-95475d81899c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd4532-b480-4825-bdb7-92dfdbee664e", "name": "network-vif-deleted", "tag": "8fc54159-dadd-4320-92b7-a2e941f93336"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:17.580798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-4de75ba6-d05c-4f19-bc03-b5c130819e6e req-4804ce84-d70c-4ab0-8eb0-95475d81899c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.581468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-4de75ba6-d05c-4f19-bc03-b5c130819e6e req-4804ce84-d70c-4ab0-8eb0-95475d81899c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:17.584267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:17.594966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-4de75ba6-d05c-4f19-bc03-b5c130819e6e req-4804ce84-d70c-4ab0-8eb0-95475d81899c service nova] Creating event network-vif-deleted:8fc54159-dadd-4320-92b7-a2e941f93336 for instance 48dd4532-b480-4825-bdb7-92dfdbee664e on hv-cinder-83699 Jun 03 16:19:17.599953 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-4de75ba6-d05c-4f19-bc03-b5c130819e6e req-4804ce84-d70c-4ab0-8eb0-95475d81899c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Jun 03 16:19:17.600558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 290/571] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:17.718013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:17.718726 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:17.725467 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.725919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:17.726688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.727130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:17.829271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:17.829978 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:17.836133 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.836588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:17.837359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.837802 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:17.854199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:17.862051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9b0c9618-c58a-441f-8848-1c26e151e86d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1370 microversion: 2.1 time: 0.148415 Jun 03 16:19:17.862625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 282/572] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:17 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:17.899636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:17.907243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-411c2790-ff14-4de8-a69a-63387bacad64 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1460 microversion: 2.1 time: 0.082199 Jun 03 16:19:17.907824 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 291/573] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:17 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1460 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:17.976350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:17.977554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:17.985799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.986245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:17.987044 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:17.987519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:18.122567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:18.130026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c154da1e-0abe-4666-9a12-71297ade2c20 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.157912 Jun 03 16:19:18.130584 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 283/574] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:17 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:18.878629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:18.879240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:18.885233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:18.885677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:18.886440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:18.886874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:18.923786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:18.924398 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:18.930778 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:18.931225 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:18.932035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:18.932497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:18.993148 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:19.000940 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d13d8693-64d5-4cb8-9f1d-89c8404cd79d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1298 microversion: 2.1 time: 0.080894 Jun 03 16:19:19.001501 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 284/575] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:18 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:19.016699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:19.024011 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4b96c8a5-2f97-4a5e-80f8-c538549ed42e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1565 microversion: 2.1 time: 0.149187 Jun 03 16:19:19.024558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 292/576] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:18 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:19.040314 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:19.040815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:19.046864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:19.047343 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:19.048117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:19.048559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:19.127469 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-84896bda-3b78-403d-b06f-e83d4c60d139 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090994 Jun 03 16:19:19.128509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 285/577] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:19:19 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:19.146650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:19.147261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:19.153431 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:19.153876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:19.154643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:19.155078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:19.288028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:19.298934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9e52ce5c-ccf7-4994-83c2-eeb865e7b3d2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.155898 Jun 03 16:19:19.303332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 293/578] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:19 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:20.005972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-8e647b23-84e3-48d3-9573-dd91d56b8f30 req-ecad1266-27e3-406d-8b75-a8f57fac8a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b7d211-5b5b-4d26-aa96-cb295c20451d", "tag": "00ec2058-4aa7-4f71-a6fa-0278283989c0"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:20.014976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-8e647b23-84e3-48d3-9573-dd91d56b8f30 req-ecad1266-27e3-406d-8b75-a8f57fac8a55 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:20.015647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-8e647b23-84e3-48d3-9573-dd91d56b8f30 req-ecad1266-27e3-406d-8b75-a8f57fac8a55 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:20.018295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:20.019086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:20.025503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:20.025955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:20.026835 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:20.027686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:20.029452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-8e647b23-84e3-48d3-9573-dd91d56b8f30 req-ecad1266-27e3-406d-8b75-a8f57fac8a55 service nova] Creating event network-changed:00ec2058-4aa7-4f71-a6fa-0278283989c0 for instance 58b7d211-5b5b-4d26-aa96-cb295c20451d on hv-cinder-83699 Jun 03 16:19:20.034488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-8e647b23-84e3-48d3-9573-dd91d56b8f30 req-ecad1266-27e3-406d-8b75-a8f57fac8a55 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032647 Jun 03 16:19:20.035599 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 286/579] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:20.059840 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:20.060293 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:20.060756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lazy-loading 'fault' on Instance uuid 48dd4532-b480-4825-bdb7-92dfdbee664e {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:19:20.108020 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:20.115668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cc9e44e5-6790-4041-9af3-d603ed0474c4 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 200 len: 1303 microversion: 2.1 time: 0.101432 Jun 03 16:19:20.116387 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 294/580] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:20 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:20.315859 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:20.316729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:20.322870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:20.323345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:20.324111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:20.324545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:20.480941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:20.492882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-769c7c70-1982-4324-96b1-e1a5c118926e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.181562 Jun 03 16:19:20.500341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 287/581] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:20 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:21.132060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:21.132678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 48dd4532-b480-4825-bdb7-92dfdbee664e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:21.138628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:21.139093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:21.139893 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:21.140339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:21.155417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] HTTP exception thrown: Instance 48dd4532-b480-4825-bdb7-92dfdbee664e could not be found. Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Request method failure captured: Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e HTTP/1.1 Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjRqn-Tvb3Y6bdl5XD4_tmUhd_3Uxvio3kqMLiWlMQzVfHU32kAGtkYnF3jefH7UaAaNeKZGeiGOULralc6U_I1EXI2lwxcPwDfn5COqBMoxqt-sJ04aeFc7w37_3Zit97EBvgo5pOpJ8vHyYs5zeDKRypVF9q6USpn3yBYlThxoPoo Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 573ee03c74e3443d8a8d5e5568507d37 Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesActionsTest-1113664126 Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:19:21.157111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/573ee03c74e3443d8a8d5e5568507d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/573ee03c74e3443d8a8d5e5568507d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/573ee03c74e3443d8a8d5e5568507d37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_573ee03c74e3443d8a8d5e5568507d37"}]}] Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesActionsTest-1113664126 Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 573ee03c74e3443d8a8d5e5568507d37 Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesActionsTest-1113664126 Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesActionsTest-1113664126-project Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 196748d4d1744c2d9fc441ea3a061dd9 Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesActionsTest-1113664126-project Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 48dd4532-b480-4825-bdb7-92dfdbee664e could not be found. Jun 03 16:19:21.158459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '48dd4532-b480-4825-bdb7-92dfdbee664e'} Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48dd4532-b480-4825-bdb7-92dfdbee664e could not be found. Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:19:21.159351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48dd4532-b480-4825-bdb7-92dfdbee664e could not be found. Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48dd4532-b480-4825-bdb7-92dfdbee664e could not be found. Jun 03 16:19:21.160909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:19:21.162600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Returning 404 to user: Instance 48dd4532-b480-4825-bdb7-92dfdbee664e could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:19:21.162600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0152098b-158a-46bc-a568-29393816b14d tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e" status: 404 len: 111 microversion: 2.1 time: 0.030260 Jun 03 16:19:21.162600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 295/582] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:21 2022] GET /compute/v2.1/servers/48dd4532-b480-4825-bdb7-92dfdbee664e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:19:21.215522 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-30576422", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "networks": [{"uuid": "4e1b45b4-00b2-4d69-b755-1aadb142f456"}]}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:21.271968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] validate_networks() for [('4e1b45b4-00b2-4d69-b755-1aadb142f456', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:19:21.509961 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:21.510573 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:21.517478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:21.517924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:21.518708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:21.519148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:21.620433 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:19:21.620855 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:19:21.621383 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:19:21.621825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:19:21.622534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:19:21.632446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:21.632976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:21.633840 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:21.634341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:21.651480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Getting quotas for project 573ee03c74e3443d8a8d5e5568507d37. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:19:21.656280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Getting quotas for user 196748d4d1744c2d9fc441ea3a061dd9 and project 573ee03c74e3443d8a8d5e5568507d37. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:19:21.658675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:21.666144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cbaeea66-3570-4517-9684-9f8141894746 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.160167 Jun 03 16:19:21.666703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 296/583] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:21 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:21.667561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:19:21.669857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:19:21.712476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4b4eb960-1684-425b-846b-9f94578372a8 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504206 Jun 03 16:19:21.713038 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 288/584] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:19:21.723333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-beee76b2-4656-4158-bdbb-b8d6a99fa7e3 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:21.723951 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-beee76b2-4656-4158-bdbb-b8d6a99fa7e3 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:21.775644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-beee76b2-4656-4158-bdbb-b8d6a99fa7e3 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:21.784076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-beee76b2-4656-4158-bdbb-b8d6a99fa7e3 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1212 microversion: 2.1 time: 0.064560 Jun 03 16:19:21.784641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 297/585] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:21 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1212 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:22.683979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:22.684745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:22.691570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:22.692268 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:22.693189 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:22.693775 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:22.804914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:22.806405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:22.812600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:22.813053 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:22.813833 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:22.814267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:22.830365 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:22.839890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8b8e71c8-846d-4490-844f-3fe990293403 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.160448 Jun 03 16:19:22.840876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 289/586] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:22 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:22.882474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:22.890819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0b2a2d51-fd96-434d-9ddf-ab9a7b6b8c66 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1270 microversion: 2.1 time: 0.093443 Jun 03 16:19:22.891398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 298/587] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:22 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:23.851183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-435b2dec-9cfa-429d-ad1c-315bd29f88fa req-b08af30c-93b1-4d7f-91bb-f77b8875e54f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502605c8-27ca-4d8a-81b8-46312aeaf234", "tag": "beb1bd6e-9e0f-4f6d-873d-82c6ca0d8d32"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:23.857545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:23.858746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:23.860542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-435b2dec-9cfa-429d-ad1c-315bd29f88fa req-b08af30c-93b1-4d7f-91bb-f77b8875e54f service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:23.861064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-435b2dec-9cfa-429d-ad1c-315bd29f88fa req-b08af30c-93b1-4d7f-91bb-f77b8875e54f service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:23.864895 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:23.865348 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:23.866125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:23.866572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:23.872881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-435b2dec-9cfa-429d-ad1c-315bd29f88fa req-b08af30c-93b1-4d7f-91bb-f77b8875e54f service nova] Creating event network-changed:beb1bd6e-9e0f-4f6d-873d-82c6ca0d8d32 for instance 502605c8-27ca-4d8a-81b8-46312aeaf234 on hv-cinder-83699 Jun 03 16:19:23.877537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-435b2dec-9cfa-429d-ad1c-315bd29f88fa req-b08af30c-93b1-4d7f-91bb-f77b8875e54f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030045 Jun 03 16:19:23.878219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 290/588] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:23.908781 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:23.909577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:23.916494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:23.916947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:23.917729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:23.918170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:24.065818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:24.073396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6c06693b-341b-4027-b802-1ca1f23b6abb tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.169125 Jun 03 16:19:24.074050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 291/589] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:23 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:24.102629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:24.110734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-159f4fec-971b-42b7-82cd-012ac43b4e4f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.257477 Jun 03 16:19:24.111532 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 299/590] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:23 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:25.090056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:25.090752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:25.097366 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:25.097818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:25.098586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:25.099026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:25.127735 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:25.128341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:25.134745 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:25.135197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:25.136088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:25.136528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:25.228127 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:25.230428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:25.238168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-38b8ecfa-55b5-4f9e-a48b-6b334dcade03 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.151978 Jun 03 16:19:25.241727 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 292/591] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:25 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:25.275416 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:25.282855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-aed52ace-e150-496a-b3b2-e80484f3348e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.158968 Jun 03 16:19:25.283431 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 300/592] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:25 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:26.264257 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:26.264872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:26.272356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:26.272796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:26.273552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:26.273982 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:26.299237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:26.299988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:26.306060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:26.306633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:26.307509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:26.308019 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:26.405120 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:26.412585 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-83da6f2a-8e03-43cc-bc42-e6413621e005 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.152975 Jun 03 16:19:26.413150 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 293/593] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:26 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:26.437417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:26.444810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c1002a35-8c0b-42c0-922b-f37f168fc26f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.149457 Jun 03 16:19:26.445398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 301/594] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:26 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:27.428977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:27.429596 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:27.436704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:27.437158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:27.437925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:27.438365 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:27.462056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:27.462691 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:27.468748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:27.469209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:27.469976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:27.470414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:27.567608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:27.575245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0895d797-ea55-475b-98ba-5bda024afea6 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.150065 Jun 03 16:19:27.575846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 294/595] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:27 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:27.603557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:27.611359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-da06e353-1388-40a9-9f35-c52a4ac362e6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.153086 Jun 03 16:19:27.611905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 302/596] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:27 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:28.591774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:28.592300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:28.598374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:28.598830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:28.599620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:28.600061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:28.627988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:28.628596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:28.634499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:28.634947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:28.635760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:28.636175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:28.726083 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:28.733457 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-df6df087-9951-4b4f-a886-3f3fca28b374 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.145876 Jun 03 16:19:28.734024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 295/597] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:28 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:28.765452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:28.772897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-56761dc5-c9b4-46c6-9270-dd89bb4163ea tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.148663 Jun 03 16:19:28.773454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 303/598] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:28 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:29.749889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:29.750508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:29.757049 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:29.757505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:29.758273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:29.758711 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:29.789282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:29.789886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:29.795920 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:29.796372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:29.797139 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:29.797575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:29.889693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:29.897174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fed538e1-ea9c-4500-affa-68d4a141205f tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.151134 Jun 03 16:19:29.898032 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 296/599] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:29 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:29.925609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:29.933060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1baa3ee7-a08d-44e8-8fb2-829afd734f64 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.147535 Jun 03 16:19:29.933625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 304/600] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:29 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:30.343558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46b92e1f-4353-4401-b29a-4dfd5728721f", "device": "/dev/sdb"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:30.345125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:30.351051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:30.351545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:30.352302 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:30.352735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:30.914694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:30.915383 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:30.922074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:30.922525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:30.923311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:30.923755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:31.058441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:31.066101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-921023b7-98b8-435b-83a9-476acebe512a tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.155267 Jun 03 16:19:31.066687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 305/601] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:30 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:31.070979 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:31.071605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:31.077627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:31.078101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:31.078915 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:31.079308 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:31.206206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:31.213559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a9e3918b-6299-4a93-bf1f-df5c40a5855d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.145938 Jun 03 16:19:31.214126 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 306/602] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:31 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:31.642629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:31.662979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=6 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:31.924865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-765b532b-d35e-4a43-8846-3034f8f9d53f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "POST /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.584929 Jun 03 16:19:31.930373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 297/603] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:19:30 2022] POST /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0/os-volume_attachments => generated 194 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:32.083582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:32.084437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:32.086658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:32.092529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:32.093073 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:32.093975 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:32.094485 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:32.227390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:32.232360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:32.233380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:32.238152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-186d46cf-616c-4949-8a9e-7bb3b265a716 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.160061 Jun 03 16:19:32.240394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:32.240919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:32.241771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:32.242273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:32.245948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 307/604] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:32 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:32.378812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:32.386227 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-16efbbd9-86a3-495d-ba52-6609381409ee tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.158993 Jun 03 16:19:32.386783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 298/605] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:32 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:33.261788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:33.262395 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:33.269061 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:33.269537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:33.270300 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:33.270731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:33.396951 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:33.399100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:33.402276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:33.402996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:33.405527 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:33.405917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-22654818-8d20-4e86-a9ee-9dee689ee226 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.147934 Jun 03 16:19:33.406520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 308/606] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:33 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:33.410776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:33.411221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:33.412009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:33.412447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:33.546338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:33.553721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8548bf41-0899-497d-bdff-b05e51b9d6bb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.155718 Jun 03 16:19:33.554273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 299/607] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:33 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:34.185437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-8b06e958-1b8b-44c9-9362-e1464a965323 req-63fe2918-bac9-4661-aa1b-c5614f007a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502605c8-27ca-4d8a-81b8-46312aeaf234", "name": "network-vif-plugged", "status": "completed", "tag": "beb1bd6e-9e0f-4f6d-873d-82c6ca0d8d32"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:34.194081 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-8b06e958-1b8b-44c9-9362-e1464a965323 req-63fe2918-bac9-4661-aa1b-c5614f007a88 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:34.194607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-8b06e958-1b8b-44c9-9362-e1464a965323 req-63fe2918-bac9-4661-aa1b-c5614f007a88 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:34.211929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-8b06e958-1b8b-44c9-9362-e1464a965323 req-63fe2918-bac9-4661-aa1b-c5614f007a88 service nova] Creating event network-vif-plugged:beb1bd6e-9e0f-4f6d-873d-82c6ca0d8d32 for instance 502605c8-27ca-4d8a-81b8-46312aeaf234 on hv-cinder-83699 Jun 03 16:19:34.218078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-8b06e958-1b8b-44c9-9362-e1464a965323 req-63fe2918-bac9-4661-aa1b-c5614f007a88 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035822 Jun 03 16:19:34.219009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 309/608] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:19:34.422436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:34.423061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:34.430183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:34.430637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:34.431443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:34.431932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:34.557048 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:34.565407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-01ac0e13-5069-403c-bc47-696473b19ff1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.146582 Jun 03 16:19:34.565976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 300/609] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:34 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:34.570430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:34.571199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:34.577883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:34.578326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:34.579078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:34.579533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:34.706848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:34.714216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-41106fad-c8a7-44d6-beda-7f2f0076d115 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.147977 Jun 03 16:19:34.714771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 310/610] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:34 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:35.582081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:35.582725 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:35.589212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:35.589659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:35.590451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:35.591533 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:35.720149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:35.727547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ac9eee2d-865b-4e02-a1cd-eb5091922628 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.149286 Jun 03 16:19:35.728112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 301/611] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:35 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:35.730288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:35.730894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:35.737109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:35.737555 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:35.738324 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:35.738764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:35.863736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:35.871015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b4b7409e-f584-4cb6-b374-cc0c13f351d4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.144504 Jun 03 16:19:35.871585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 311/612] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:35 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:36.316846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-5a602118-a300-421f-9680-eaa9910e3c7a req-961e2bb7-5cc7-4608-aea1-6cbaa138e702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea2cd56-026c-4b2e-a39a-35bc5db65f46", "name": "network-vif-plugged", "status": "completed", "tag": "373d5130-e651-4986-b65f-2e89d25c7140"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:36.325168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5a602118-a300-421f-9680-eaa9910e3c7a req-961e2bb7-5cc7-4608-aea1-6cbaa138e702 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:36.326266 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5a602118-a300-421f-9680-eaa9910e3c7a req-961e2bb7-5cc7-4608-aea1-6cbaa138e702 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:36.338214 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-5a602118-a300-421f-9680-eaa9910e3c7a req-961e2bb7-5cc7-4608-aea1-6cbaa138e702 service nova] Creating event network-vif-plugged:373d5130-e651-4986-b65f-2e89d25c7140 for instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 on hv-cinder-83699 Jun 03 16:19:36.343092 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-5a602118-a300-421f-9680-eaa9910e3c7a req-961e2bb7-5cc7-4608-aea1-6cbaa138e702 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030032 Jun 03 16:19:36.343961 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 302/613] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:36.744178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:36.744787 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:36.750810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:36.751258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:36.752058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:36.752491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:36.878839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:36.886492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-db46d3ba-e0b6-48eb-b6c4-ef9487f1a064 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1312 microversion: 2.1 time: 0.146097 Jun 03 16:19:36.887054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 312/614] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:36 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:36.888164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:36.888869 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:36.896403 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:36.896847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:36.897636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:36.898063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:37.024700 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:37.032717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e262775c-9b5d-4b3a-80d8-0f261328419f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.148853 Jun 03 16:19:37.033287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 303/615] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:36 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:37.903166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:37.903810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:37.909827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:37.910280 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:37.911045 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:37.911519 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.040168 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:38.047948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f5c6638a-3358-474a-a857-b30d4466c406 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1496 microversion: 2.1 time: 0.148774 Jun 03 16:19:38.048647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 313/616] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:37 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1496 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:38.049811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:38.050435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:38.057104 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:38.057554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.058322 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:38.058769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.187216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:38.194781 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7790a4e9-b13c-4828-82ef-12025553b04b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.148860 Jun 03 16:19:38.195360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 304/617] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:38 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:19:38.547827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:38.548323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:38.554692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:38.555164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.555960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:38.556392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.580909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:19:38.654203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f188587d-d707-4218-bd67-c31949057b20 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "DELETE /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 204 len: 0 microversion: 2.1 time: 0.109865 Jun 03 16:19:38.654767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 314/618] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:19:38 2022] DELETE /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:19:38.662884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:38.663526 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:38.669455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:38.669891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.670647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:38.671079 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:38.798663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:38.806024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b3788f4c-68cc-4862-8576-1fb2ba8a08f1 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1502 microversion: 2.1 time: 0.146985 Jun 03 16:19:38.806531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 305/619] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:38 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:39.211995 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:39.212693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:39.218582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:39.219032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:39.219829 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:39.220275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:39.356638 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:39.364671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9c990d7d-fbc7-4a80-ac86-7ed8cf7360e0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.157017 Jun 03 16:19:39.365225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 315/620] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:39 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:39.822895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:39.823554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:39.830638 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:39.831111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:39.831895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:39.832342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:39.956968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:39.964410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c18b976a-b0e6-4f4b-b7e9-8922425b20c9 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1502 microversion: 2.1 time: 0.145451 Jun 03 16:19:39.964977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 306/621] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:39 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1502 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:40.380447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:40.381128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:40.387045 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:40.387536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:40.388309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:40.388747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:40.518082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:40.525738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7b02e70c-60e0-45e4-a974-485347f945e5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1264 microversion: 2.1 time: 0.149082 Jun 03 16:19:40.526298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 316/622] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:40 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:40.980598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:40.981280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:40.988300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:40.988759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:40.989525 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:40.989965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:41.342749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:41.350647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-74855a33-9ee5-481b-9f98-ff7888c4f48c tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1502 microversion: 2.1 time: 0.373883 Jun 03 16:19:41.351454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 307/623] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:40 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:41.542345 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:41.542929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:41.549634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:41.550089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:41.550861 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:41.551317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:41.679381 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:41.686819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d29c3e90-b0d8-4cb6-92ac-79585836e1d7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1451 microversion: 2.1 time: 0.148500 Jun 03 16:19:41.687395 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 317/624] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:41 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:41.702818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:41.703459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:41.709414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:41.709862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:41.710620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:41.711056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:41.843657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:41.845947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:19:41.852304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6a1fe733-1cc2-4002-80bb-c03b4da30d87 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1451 microversion: 2.1 time: 0.153744 Jun 03 16:19:41.852866 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 308/625] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:41 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:42.368647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:42.369388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:42.377206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:42.377720 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:42.378609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:42.379169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:42.577045 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '196748d4d1744c2d9fc441ea3a061dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573ee03c74e3443d8a8d5e5568507d37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:19:42.586271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2315ef0b-7164-454e-8b6c-23781f5e5056 tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 200 len: 1502 microversion: 2.1 time: 0.221929 Jun 03 16:19:42.587361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 318/626] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:42 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:19:42.704693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-6a5dd1dd-3e26-4455-bde0-6e202e4754a2 req-55c2049c-771b-4231-a7ea-beb8ecbbe568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502605c8-27ca-4d8a-81b8-46312aeaf234", "name": "network-vif-deleted", "tag": "beb1bd6e-9e0f-4f6d-873d-82c6ca0d8d32"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:42.720852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-6a5dd1dd-3e26-4455-bde0-6e202e4754a2 req-55c2049c-771b-4231-a7ea-beb8ecbbe568 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:42.721806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-6a5dd1dd-3e26-4455-bde0-6e202e4754a2 req-55c2049c-771b-4231-a7ea-beb8ecbbe568 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:42.736910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-6a5dd1dd-3e26-4455-bde0-6e202e4754a2 req-55c2049c-771b-4231-a7ea-beb8ecbbe568 service nova] Creating event network-vif-deleted:beb1bd6e-9e0f-4f6d-873d-82c6ca0d8d32 for instance 502605c8-27ca-4d8a-81b8-46312aeaf234 on hv-cinder-83699 Jun 03 16:19:42.742142 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-6a5dd1dd-3e26-4455-bde0-6e202e4754a2 req-55c2049c-771b-4231-a7ea-beb8ecbbe568 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041007 Jun 03 16:19:42.742986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 309/627] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:43.585466 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-c63d01ab-a2b5-49ce-bbac-1c2f03b7902e req-a00a0b1e-9996-4b1e-8321-ba5eeff002f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea2cd56-026c-4b2e-a39a-35bc5db65f46", "tag": "373d5130-e651-4986-b65f-2e89d25c7140"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:19:43.593505 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-c63d01ab-a2b5-49ce-bbac-1c2f03b7902e req-a00a0b1e-9996-4b1e-8321-ba5eeff002f3 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:43.593958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-c63d01ab-a2b5-49ce-bbac-1c2f03b7902e req-a00a0b1e-9996-4b1e-8321-ba5eeff002f3 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:43.604708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:19:43.605207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-c63d01ab-a2b5-49ce-bbac-1c2f03b7902e req-a00a0b1e-9996-4b1e-8321-ba5eeff002f3 service nova] Creating event network-changed:373d5130-e651-4986-b65f-2e89d25c7140 for instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 on hv-cinder-83699 Jun 03 16:19:43.605408 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] [instance: 502605c8-27ca-4d8a-81b8-46312aeaf234] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:19:43.610760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-c63d01ab-a2b5-49ce-bbac-1c2f03b7902e req-a00a0b1e-9996-4b1e-8321-ba5eeff002f3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028814 Jun 03 16:19:43.611457 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 319/628] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:19:43.612497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:43.612643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:43.613523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:19:43.613901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:19:43.627842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] HTTP exception thrown: Instance 502605c8-27ca-4d8a-81b8-46312aeaf234 could not be found. Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Request method failure captured: Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 HTTP/1.1 Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjRqn-Tvb3Y6bdl5XD4_tmUhd_3Uxvio3kqMLiWlMQzVfHU32kAGtkYnF3jefH7UaAaNeKZGeiGOULralc6U_I1EXI2lwxcPwDfn5COqBMoxqt-sJ04aeFc7w37_3Zit97EBvgo5pOpJ8vHyYs5zeDKRypVF9q6USpn3yBYlThxoPoo Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 573ee03c74e3443d8a8d5e5568507d37 Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesActionsTest-1113664126 Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:19:43.629481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/573ee03c74e3443d8a8d5e5568507d37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/573ee03c74e3443d8a8d5e5568507d37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/573ee03c74e3443d8a8d5e5568507d37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_573ee03c74e3443d8a8d5e5568507d37"}]}] Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesActionsTest-1113664126 Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 573ee03c74e3443d8a8d5e5568507d37 Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesActionsTest-1113664126 Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesActionsTest-1113664126-project Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 196748d4d1744c2d9fc441ea3a061dd9 Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesActionsTest-1113664126-project Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 502605c8-27ca-4d8a-81b8-46312aeaf234 could not be found. Jun 03 16:19:43.630793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '502605c8-27ca-4d8a-81b8-46312aeaf234'} Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502605c8-27ca-4d8a-81b8-46312aeaf234 could not be found. Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:19:43.631577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502605c8-27ca-4d8a-81b8-46312aeaf234 could not be found. Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502605c8-27ca-4d8a-81b8-46312aeaf234 could not be found. Jun 03 16:19:43.632944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:19:43.634144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] Returning 404 to user: Instance 502605c8-27ca-4d8a-81b8-46312aeaf234 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:19:43.634144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ec15018a-524f-498b-914b-23ccad936c2b tempest-VolumesActionsTest-1113664126 tempest-VolumesActionsTest-1113664126-project] 10.222.0.41 "GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234" status: 404 len: 111 microversion: 2.1 time: 0.030748 Jun 03 16:19:43.634144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 310/629] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:19:43 2022] GET /compute/v2.1/servers/502605c8-27ca-4d8a-81b8-46312aeaf234 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 16:20:09.135793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:09.136241 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:09.140936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:09.141524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:09.149327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:09.150174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:09.151227 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:09.151638 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:09.310411 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lazy-loading 'services' on Instance uuid 0a1a049c-1161-4126-8866-62c500132dd0 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:20:09.452607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-43818ac2-1832-4b7a-830c-767e20e8a72d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0/os-volume_attachments/46b92e1f-4353-4401-b29a-4dfd5728721f" status: 202 len: 0 microversion: 2.1 time: 0.317983 Jun 03 16:20:09.455331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 320/630] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:20:09 2022] DELETE /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0/os-volume_attachments/46b92e1f-4353-4401-b29a-4dfd5728721f => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:20:11.673494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:11.674051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:11.676929 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=23 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:11.678751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=5 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:11.685084 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:11.685535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:11.686471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:11.687137 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:11.713750 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:20:11.794671 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b67e022b-5481-45cc-8faf-485d0f6c2b51 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 204 len: 0 microversion: 2.1 time: 0.124785 Jun 03 16:20:11.798625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 311/631] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:20:11 2022] DELETE /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:20:11.804697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:11.805445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:11.813636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:11.814097 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:11.814889 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:11.815363 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:11.961056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:11.971625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ceb337c9-6991-40af-88f8-2fabd2f1bc71 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1514 microversion: 2.1 time: 0.171103 Jun 03 16:20:11.972625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 321/632] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:11 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:12.989248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:12.989979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:12.996778 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:12.997225 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:12.997994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:12.998429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:13.141797 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:13.154799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fb64a724-f632-4e65-b026-743948bd5449 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1514 microversion: 2.1 time: 0.170257 Jun 03 16:20:13.164155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 312/633] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:12 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:14.172491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:14.173135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:14.179503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:14.180046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:14.180814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:14.181267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:14.320565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:14.328337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8335dca2-74c9-44ff-a4d6-76424512b16c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1514 microversion: 2.1 time: 0.159836 Jun 03 16:20:14.337558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 322/634] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:14 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:14.823061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-e4386206-090e-4682-97d2-05dd7ec23d41 req-c1cd2acd-1096-408e-b637-f7e29a5f5036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1a049c-1161-4126-8866-62c500132dd0", "name": "network-vif-deleted", "tag": "0a0da5af-7964-4f97-92ed-782676453f7c"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:14.833149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-e4386206-090e-4682-97d2-05dd7ec23d41 req-c1cd2acd-1096-408e-b637-f7e29a5f5036 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:14.833594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-e4386206-090e-4682-97d2-05dd7ec23d41 req-c1cd2acd-1096-408e-b637-f7e29a5f5036 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:14.845959 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-e4386206-090e-4682-97d2-05dd7ec23d41 req-c1cd2acd-1096-408e-b637-f7e29a5f5036 service nova] Creating event network-vif-deleted:0a0da5af-7964-4f97-92ed-782676453f7c for instance 0a1a049c-1161-4126-8866-62c500132dd0 on hv-cinder-83699 Jun 03 16:20:14.850705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-e4386206-090e-4682-97d2-05dd7ec23d41 req-c1cd2acd-1096-408e-b637-f7e29a5f5036 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031269 Jun 03 16:20:14.851487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 313/635] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:15.346127 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:15.346827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:15.352929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:15.353511 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:15.354115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:15.355503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:15.389414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:15.389867 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:15.390536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lazy-loading 'fault' on Instance uuid 0a1a049c-1161-4126-8866-62c500132dd0 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:20:15.441150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:15.449244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a4223696-24a5-4c76-a2a7-39af0c8572a1 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 200 len: 1309 microversion: 2.1 time: 0.106807 Jun 03 16:20:15.449935 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 323/636] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:15 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:16.467976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:16.468653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 0a1a049c-1161-4126-8866-62c500132dd0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:16.474718 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:16.475163 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:16.475943 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:16.476378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:16.491507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] HTTP exception thrown: Instance 0a1a049c-1161-4126-8866-62c500132dd0 could not be found. Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Request method failure captured: Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 HTTP/1.1 Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjRlVX1mz5D59bt5AGf5J8BD6LWB4dEy1uhlORBBcz7MeunHQS_1Kb3TBde974BxUapms6t5bi3hfdWz90zxTvxajRab9L9kNvF2poLRJqPOYQQkLZ1VhAnjxH9DMycVj6zxeFtJGWorb6XJP93lDFblVzVmW2e4wae4wAXLxoH4_vE Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 1b5c201aae5e438c81d8976289ffb4cb Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2076250543 Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:20:16.493146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1b5c201aae5e438c81d8976289ffb4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1b5c201aae5e438c81d8976289ffb4cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1b5c201aae5e438c81d8976289ffb4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1b5c201aae5e438c81d8976289ffb4cb"}]}] Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesSnapshotTestJSON-2076250543 Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 1b5c201aae5e438c81d8976289ffb4cb Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2076250543 Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesSnapshotTestJSON-2076250543-project Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 12a595db7f394c7e86b6a9e0c9f625f8 Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesSnapshotTestJSON-2076250543-project Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 0a1a049c-1161-4126-8866-62c500132dd0 could not be found. Jun 03 16:20:16.494860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '0a1a049c-1161-4126-8866-62c500132dd0'} Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1a049c-1161-4126-8866-62c500132dd0 could not be found. Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:20:16.495916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1a049c-1161-4126-8866-62c500132dd0 could not be found. Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1a049c-1161-4126-8866-62c500132dd0 could not be found. Jun 03 16:20:16.497739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:20:16.498924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Returning 404 to user: Instance 0a1a049c-1161-4126-8866-62c500132dd0 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:20:16.498924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-93179503-4149-45b6-9c90-3af2f6dfcb0d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0" status: 404 len: 111 microversion: 2.1 time: 0.031361 Jun 03 16:20:16.498924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 314/637] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:16 2022] GET /compute/v2.1/servers/0a1a049c-1161-4126-8866-62c500132dd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:20:25.771398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:25.771966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:25.774298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=10 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:25.774945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:25.780680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:25.781134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:25.781971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:25.782386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:25.805224 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-659c7d45-eb65-4f2a-8560-72e75052464a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/ips" status: 200 len: 146 microversion: 2.1 time: 0.037693 Jun 03 16:20:25.805786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 324/638] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:20:25 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:30.997760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:30.998280 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:31.000445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:31.001335 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:31.007506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:31.007949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:31.008700 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:31.009136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:31.032617 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4c479d05-ec6a-4e87-84aa-3acb479e25a5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/ips" status: 200 len: 151 microversion: 2.20 time: 0.038912 Jun 03 16:20:31.033162 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 315/639] 10.222.0.41 () {60 vars in 1288 bytes} [Fri Jun 3 16:20:30 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:20:33.556377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-463591937", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "networks": [{"uuid": "018ab0be-ad68-404f-ba6e-516f8e1af734"}]}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:33.606188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] validate_networks() for [('018ab0be-ad68-404f-ba6e-516f8e1af734', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:20:33.936370 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:20:33.936795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:20:33.937266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:20:33.937670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:20:33.938077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:20:33.947404 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:33.947846 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:33.948667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:33.949099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:33.965974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Getting quotas for project 1b5c201aae5e438c81d8976289ffb4cb. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:20:33.969868 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Getting quotas for user 12a595db7f394c7e86b6a9e0c9f625f8 and project 1b5c201aae5e438c81d8976289ffb4cb. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:20:33.980495 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:20:33.982680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:20:34.027006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-759a4111-d5e7-45ba-bd40-93ad867d24d8 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474389 Jun 03 16:20:34.027886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 325/640] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:20:34.037625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d057cfe2-d1e4-493e-bf2b-41059c910d77 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:34.038233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d057cfe2-d1e4-493e-bf2b-41059c910d77 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:34.094752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d057cfe2-d1e4-493e-bf2b-41059c910d77 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:34.102804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d057cfe2-d1e4-493e-bf2b-41059c910d77 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1218 microversion: 2.1 time: 0.068928 Jun 03 16:20:34.112346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 316/641] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:34 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:34.146695 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9602843-9199-4436-a162-bbd89e478f8a"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:34.147839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:34.154215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:34.154666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:34.155475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:34.155916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:34.441581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-57c62b7a-3a9f-443e-b374-5a189522341d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298620 Jun 03 16:20:34.442842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 326/642] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:20:34 2022] POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:35.120396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:35.121015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:35.128771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:35.129422 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:35.130222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:35.130700 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:35.200327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:35.208424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3419a8ef-19b9-4488-b28d-16e6d69fcbda tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1278 microversion: 2.1 time: 0.091955 Jun 03 16:20:35.209231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 317/643] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:35 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:36.032002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:36.033845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:36.042048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.042870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.043924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.044589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.069948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lazy-loading 'flavor' on Instance uuid a565de36-676c-4b81-ae49-3dfadf4dbd06 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:20:36.230950 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:36.232029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:36.243944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.244831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.254306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.255051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.434331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7ee0576f-9ee0-458e-bc4d-f4468102948e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/action" status: 202 len: 0 microversion: 2.20 time: 0.405687 Jun 03 16:20:36.436064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 327/644] 10.222.0.41 () {62 vars in 1318 bytes} [Fri Jun 3 16:20:36 2022] POST /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:20:36.445846 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:36.447167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:36.456503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.457287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.458563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.459588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.483620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:36.494354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-12212f9a-4f30-4fab-a4d6-875c30bd8b3f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.271827 Jun 03 16:20:36.495820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 318/645] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:36 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:36.679353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-d49a9048-8cd8-413f-b090-391b48ba934c req-38b3c1d4-f0e8-4ed9-af68-9a06285472e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42eb67eb-b939-4633-bea4-2cc1db4b7f1d", "tag": "a82127a2-5b2e-49b0-88b4-20b967cc8d05"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:36.689374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-d49a9048-8cd8-413f-b090-391b48ba934c req-38b3c1d4-f0e8-4ed9-af68-9a06285472e3 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:36.689809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-d49a9048-8cd8-413f-b090-391b48ba934c req-38b3c1d4-f0e8-4ed9-af68-9a06285472e3 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:36.703636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-d49a9048-8cd8-413f-b090-391b48ba934c req-38b3c1d4-f0e8-4ed9-af68-9a06285472e3 service nova] Creating event network-changed:a82127a2-5b2e-49b0-88b4-20b967cc8d05 for instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d on hv-cinder-83699 Jun 03 16:20:36.709431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-d49a9048-8cd8-413f-b090-391b48ba934c req-38b3c1d4-f0e8-4ed9-af68-9a06285472e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 Jun 03 16:20:36.710383 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 319/646] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:20:36.720950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:36.729955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:36.731524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:36.732685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ea0ff319-e761-4ec0-8792-6c545dc96c2b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.291956 Jun 03 16:20:36.733236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 328/647] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:36 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:37.515654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:37.516347 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:37.523771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:37.524220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:37.524980 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:37.525431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:37.650849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:37.658560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-461d8598-1991-4925-b28e-eddc6c305906 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.147111 Jun 03 16:20:37.659134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 320/648] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:37 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:37.751599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:37.752212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:37.758636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:37.759088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:37.759896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:37.760336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:37.884966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:37.893206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:37.894714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:37.895890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-faef2255-1f1c-4a3a-827f-59083396deb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.148112 Jun 03 16:20:37.896443 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 329/649] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:37 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:38.675741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:38.676354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:38.682770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:38.683215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:38.684008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:38.684441 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:38.830524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:38.837798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2b300518-4324-4311-9e87-dbc007d98d5d tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.166419 Jun 03 16:20:38.838348 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 321/650] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:38 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:38.914794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:38.915433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:38.921801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:38.922245 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:38.923009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:38.923569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:39.052264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:39.060102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:39.061614 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:39.062764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f33359ba-bbb5-45e1-b9e2-7c0ae5011e04 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.151900 Jun 03 16:20:39.063327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 330/651] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:38 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:39.501563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:39.502064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:39.508172 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:39.508580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:39.509342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:39.509784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:39.532608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c1ce8683-1c6d-4e22-822b-e0c75b05b5d9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/ips" status: 200 len: 150 microversion: 2.1 time: 0.035006 Jun 03 16:20:39.533805 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 322/652] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:20:39 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:39.854228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:39.854844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:39.861000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:39.861451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:39.862276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:39.862721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:39.989480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:39.996732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c63e576d-fae8-4807-b8e0-62f73a5280ba tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.146563 Jun 03 16:20:39.997281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 331/653] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:39 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:40.080199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:40.080880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:40.087685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:40.088140 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:40.088910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:40.089353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:40.214279 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:40.222188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:40.223777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:40.224945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2ab99db9-4746-44a8-a1b8-755cdbdb7c02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.148760 Jun 03 16:20:40.225716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 323/654] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:40 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:40.874971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52750c5-c512-46e8-b422-4f637bf18d22"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:40.876116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:40.882014 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:40.882462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:40.883249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:40.883708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:41.014117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:41.014675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:41.020965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:41.021418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:41.022181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:41.022620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:41.147246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:41.155005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-dc5b93d9-7c4e-450b-95a2-7a55e8b5372e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.144962 Jun 03 16:20:41.155586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 324/655] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:41 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:41.243014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:41.243764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:41.250247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:41.250719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:41.251534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:41.251999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:41.384294 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:41.392155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:41.394165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:41.395334 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-95db912a-1448-4662-81bc-233d8226b974 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.156162 Jun 03 16:20:41.395894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 325/656] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:41 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:20:42.172945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:42.174404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:42.182565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:42.183013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:42.184072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:42.184874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:42.320298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2e25a79c-b0b1-49d9-b466-c816898983d1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.449004 Jun 03 16:20:42.321213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 332/657] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:20:40 2022] POST /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments => generated 194 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:42.325835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:42.333921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-77c15c88-9474-44a9-8729-6853d289e441 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.165202 Jun 03 16:20:42.334477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 326/658] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:42 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:42.414373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:42.415094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:42.421742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:42.422186 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:42.422997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:42.423440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:42.548682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:42.557059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:42.558574 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:42.559768 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9f70e842-1a2e-448c-8bb1-785de9a892b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.150208 Jun 03 16:20:42.560325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 333/659] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:42 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:20:43.017975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4353c700-6dcd-4a82-85c8-fc5eb92b7ec8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:43.024432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4353c700-6dcd-4a82-85c8-fc5eb92b7ec8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.024885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4353c700-6dcd-4a82-85c8-fc5eb92b7ec8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.084321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4353c700-6dcd-4a82-85c8-fc5eb92b7ec8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Going to try to stop instance {{(pid=117570) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 16:20:43.126241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4353c700-6dcd-4a82-85c8-fc5eb92b7ec8 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action" status: 202 len: 0 microversion: 2.1 time: 0.111869 Jun 03 16:20:43.127023 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 327/660] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:20:43 2022] POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:20:43.135755 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:43.136430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:43.143082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.143591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.144888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.145336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.273909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:43.282415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bb5e1e0b-287e-4a07-9c97-f7f270270c84 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.150445 Jun 03 16:20:43.282959 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 334/661] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:43 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:43.351402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:43.352116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:43.358186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.358636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.359438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.359877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.578002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:43.578606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:43.584608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.585055 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.585906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:43.586344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:43.657046 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:43.665295 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-31576b44-a522-4bb0-bf2e-8f5ba8cb3b0c tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.318966 Jun 03 16:20:43.665880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 328/662] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:43 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:43.934203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:43.942031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:43.943523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:43.944672 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-df3d12bd-7e76-4816-a224-f13b2ecd74e1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.370600 Jun 03 16:20:43.945233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 335/663] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:43 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:20:44.300195 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:44.300827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:44.302782 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:44.308314 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.308763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:44.309520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.309956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:44.442216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:44.450024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1371f18a-55d8-4ffc-b7fe-66a2776d33dc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.153699 Jun 03 16:20:44.450582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 329/664] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:44 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:44.681818 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:44.682439 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:44.684446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:44.685589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=6 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:44.693134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.693599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:44.694381 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.694827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:44.832645 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-02fa689b-36dd-40d7-ac67-6ed5c2f035b6 req-901d3fb4-d5de-457b-9b5b-140c9345acfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb67eb-b939-4633-bea4-2cc1db4b7f1d", "name": "network-vif-plugged", "status": "completed", "tag": "a82127a2-5b2e-49b0-88b4-20b967cc8d05"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:44.840328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:44.843710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:44.848984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-33c71ef2-679d-4409-871b-6b25c8f0dc14 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.170930 Jun 03 16:20:44.849644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 336/665] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:44 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:44.850241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-02fa689b-36dd-40d7-ac67-6ed5c2f035b6 req-901d3fb4-d5de-457b-9b5b-140c9345acfc service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.850695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-02fa689b-36dd-40d7-ac67-6ed5c2f035b6 req-901d3fb4-d5de-457b-9b5b-140c9345acfc service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:44.861795 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-02fa689b-36dd-40d7-ac67-6ed5c2f035b6 req-901d3fb4-d5de-457b-9b5b-140c9345acfc service nova] Creating event network-vif-plugged:a82127a2-5b2e-49b0-88b4-20b967cc8d05 for instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d on hv-cinder-83699 Jun 03 16:20:44.867468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-02fa689b-36dd-40d7-ac67-6ed5c2f035b6 req-901d3fb4-d5de-457b-9b5b-140c9345acfc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046272 Jun 03 16:20:44.868107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 330/666] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:44.963418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:44.963418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:44.970847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.971326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:44.972694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:44.973138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:45.155054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:45.163559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:45.165072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:45.166223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a144baba-c8ba-4a45-809d-37f5b19e26dc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.208163 Jun 03 16:20:45.166776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 337/667] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:44 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:45.468881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:45.469587 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:45.476468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:45.476927 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:45.477696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:45.478136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:45.606074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:45.613946 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a7dd2a30-a571-49a9-9448-48674ca536b2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.149819 Jun 03 16:20:45.614507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 331/668] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:45 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:45.866741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:45.867272 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:45.873734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:45.874191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:45.874990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:45.875466 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:46.010592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:46.018256 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-97c21d36-0484-42a1-a69c-00f0ddf1a922 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.155984 Jun 03 16:20:46.019773 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 338/669] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:45 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:46.184449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:46.185061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:46.191155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:46.191651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:46.192408 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:46.192844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:46.320692 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:46.328467 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:46.329971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:46.331676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-14430b91-5242-49fa-bda9-b171b0549874 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.150677 Jun 03 16:20:46.332229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 332/670] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:46 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:46.631410 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:46.632026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:46.638084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:46.638539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:46.639324 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:46.639774 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:46.761477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:46.769265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-982de29f-10e9-436d-b044-4cfd507d3536 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.142257 Jun 03 16:20:46.769831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 339/671] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:46 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:47.037049 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:47.037580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:47.044042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:47.044490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:47.045250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:47.045684 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:47.063941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:47.171988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:47.180067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-87d2c8f8-e0cf-4faf-9d9f-cc381ba4eda9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1318 microversion: 2.1 time: 0.147394 Jun 03 16:20:47.180628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 333/672] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:47 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:47.349432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:47.349973 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:47.356332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:47.356777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:47.357537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:47.357968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:47.489030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:47.496816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:47.498307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:47.499478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2b200658-ce30-479b-a1c7-75dfdfc86c7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.154453 Jun 03 16:20:47.500100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 340/673] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:47 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:20:47.786990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:47.787630 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:47.793753 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:47.794202 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:47.794968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:47.795432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:47.922377 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:47.930923 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bd05329f-bfb3-489e-80a4-b2553393a4de tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.148253 Jun 03 16:20:47.931519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 334/674] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:47 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:48.196242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:48.196867 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:48.202916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.203398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.204173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.204616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.386398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:48.394307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a5985f8f-8d9d-4357-b95e-9b573ce8afa9 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1508 microversion: 2.1 time: 0.202024 Jun 03 16:20:48.394857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 341/675] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:48 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:48.411269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06192d53-b558-416a-b5bb-b80738bcb52e", "device": "/dev/sdb"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:48.412450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:48.418951 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.419460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.420193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.420634 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.517494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:48.518109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:48.525388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.525844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.526728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.527174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.654628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:48.662367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:48.663891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:48.665034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a012bfde-1b1a-45d4-88d3-aec32d3bd688 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.151523 Jun 03 16:20:48.665586 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 342/676] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:48 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:20:48.948048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:48.948679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:48.954736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.955181 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:48.955976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:48.956416 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:49.083544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:49.091518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-27b26588-8982-48ee-8ad7-8264aa9d798d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.147279 Jun 03 16:20:49.092069 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 343/677] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:48 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:49.683689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:49.684377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:49.690809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:49.691258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:49.692060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:49.692495 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:49.820707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:49.828570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:49.830078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:49.831744 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-eaf13884-bef6-4e47-b33f-252890bddf23 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.152038 Jun 03 16:20:49.832326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 344/678] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:49 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:20:50.108922 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:50.109557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:50.112056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-842a097a-b72d-4852-ad5e-d7ee7253a31b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "POST /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.705170 Jun 03 16:20:50.112961 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 335/679] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:20:48 2022] POST /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d/os-volume_attachments => generated 194 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:20:50.115865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:50.116313 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:50.117175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:50.117621 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:50.248606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:50.257077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-78d151dc-9dfe-4200-906a-73492a345886 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.152091 Jun 03 16:20:50.257640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 345/680] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:50 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:50.864957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-10e7e77c-fe09-4d3c-b0cb-de8608b0e089 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: .version_select at 0x7fb5c5e47b80>, body: {"keypair": {"name": "tempest-keypair-591494786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6GAHT1sAAEgDf9aWewgO69GDuNTMgx8MCWAowryXjXAgxMfeBfYHt/RWrB0B23ABZm6vGQvdK/R6ULo5txp5++3PWs6Zj2o6sbhCERkK1lSVRaSgx+6VoPpsvVpSU8ww=="}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:50.880212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-10e7e77c-fe09-4d3c-b0cb-de8608b0e089 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:20:50.884292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-10e7e77c-fe09-4d3c-b0cb-de8608b0e089 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:20:50.917398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-10e7e77c-fe09-4d3c-b0cb-de8608b0e089 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056795 Jun 03 16:20:50.918081 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 346/681] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:20:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:50.984328 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:50.985031 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:50.992618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:50.993148 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:50.993999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:50.994510 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:51.131382 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:51.139733 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:51.141454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:51.142645 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cd9e4f57-38f3-4911-90a9-e22fa5b9f888 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.295302 Jun 03 16:20:51.143753 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 336/682] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:50 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:51.276565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:51.280178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:51.287384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:51.287834 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:51.288614 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:51.289048 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:51.537900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:51.547337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-22b82b7c-e971-46f7-8687-aff0bf108063 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.277102 Jun 03 16:20:51.549101 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 347/683] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:51 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:52.161998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:52.162649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:52.169384 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:52.169840 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:52.170611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:52.171051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:52.566462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:52.567006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:52.573708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:52.574169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:52.574956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:52.575429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:52.598561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:52.608118 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:52.610793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:52.612932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-76907713-cc3e-4717-8547-a2efc3922739 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.454194 Jun 03 16:20:52.614019 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 337/684] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:52 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:52.706659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:52.714628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ebd7a322-982a-450d-91a5-80ad6eebcc89 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.152480 Jun 03 16:20:52.715192 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 348/685] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:52 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:52.717279 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-811264978", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb749c5-3e3e-449b-80a2-fa7c692f9d8e"}], "security_groups": [{"name": "tempest-securitygroup--1052119860"}], "key_name": "tempest-keypair-591494786", "user_data": "}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:52.814868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] validate_networks() for [('6fb749c5-3e3e-449b-80a2-fa7c692f9d8e', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:20:53.215725 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:20:53.216205 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:20:53.216611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:20:53.217017 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:20:53.217427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:20:53.226262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:53.226709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:53.227550 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:53.227988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:53.244462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:20:53.249516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:20:53.261364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:20:53.263673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:20:53.309019 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-dde5befa-48ce-4287-9659-cd2a6c2589e4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645116 Jun 03 16:20:53.309669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 338/686] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:20:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 16:20:53.320838 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-477fa355-508a-4ccc-a99c-20fd3e1c6f28 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:53.321608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-477fa355-508a-4ccc-a99c-20fd3e1c6f28 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:53.378277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-477fa355-508a-4ccc-a99c-20fd3e1c6f28 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:53.385185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-477fa355-508a-4ccc-a99c-20fd3e1c6f28 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1240 microversion: 2.1 time: 0.068986 Jun 03 16:20:53.385733 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 349/687] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:53 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:53.632749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:53.633359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:53.640144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:53.640589 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:53.641354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:53.641787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:53.732164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:53.732872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:53.740142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:53.740588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:53.741544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:53.742058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:53.776318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:53.784853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:53.786367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:53.787589 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7327ab08-c971-482b-b30c-54afb4b13261 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.158689 Jun 03 16:20:53.789008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 339/688] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:53 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:53.875819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:53.883693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ac3a59a9-3a38-44fc-a558-c7a722defa63 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.155445 Jun 03 16:20:53.884177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 350/689] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:53 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:54.402072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:54.402687 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:54.408680 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:54.409681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:54.410455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:54.410892 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:54.470082 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:54.478187 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3e4e4b12-3323-4c8c-9eca-52917967006f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1236 microversion: 2.1 time: 0.080143 Jun 03 16:20:54.478758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 340/690] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:54 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:54.806478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:54.807100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:54.813677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:54.814135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:54.814913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:54.815388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:54.900618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:54.901439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:54.908061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:54.908878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:54.910312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:54.910794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:55.014067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:55.024246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:55.026263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:55.027793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fb06831f-ab6c-4247-851a-32d303623e18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.225209 Jun 03 16:20:55.028764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 351/691] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:54 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:55.055121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:55.063158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6eb511bf-69bf-40e3-bdbc-0a60f0c0287b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.166579 Jun 03 16:20:55.063682 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 341/692] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:54 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:55.494984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:55.495621 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:55.501590 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:55.502040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:55.502814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:55.503251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:55.582470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:55.590236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d6cd8cc2-c728-49cc-8fe3-28bd878dac1c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1298 microversion: 2.1 time: 0.099271 Jun 03 16:20:55.590815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 352/693] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:55 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:56.046695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:56.047463 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:56.053924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.054371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.055141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.055597 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.081271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:56.082664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:56.085946 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:56.092961 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.093653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.094397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.094898 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.230632 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:56.240292 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:56.241790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:56.242944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f947f261-802a-49dc-adb4-dd6f4e67a37b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.200251 Jun 03 16:20:56.243559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 342/694] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:56 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:56.311970 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:56.321650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b71dc72d-36a2-4d6d-952c-b18cb25e5853 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.244960 Jun 03 16:20:56.322237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 353/695] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:56 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:56.576636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-f7a41ade-5bf3-4400-af73-5b625b7c9f8f req-1eaae3e2-a83f-42ce-a289-57bfcdda417e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962bba3e-675b-481f-840a-f5d0d2540cb5", "tag": "d868f766-fcef-4abb-aaea-7f4466fd0395"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:56.586759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-f7a41ade-5bf3-4400-af73-5b625b7c9f8f req-1eaae3e2-a83f-42ce-a289-57bfcdda417e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.587261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-f7a41ade-5bf3-4400-af73-5b625b7c9f8f req-1eaae3e2-a83f-42ce-a289-57bfcdda417e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.600729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-f7a41ade-5bf3-4400-af73-5b625b7c9f8f req-1eaae3e2-a83f-42ce-a289-57bfcdda417e service nova] Creating event network-changed:d868f766-fcef-4abb-aaea-7f4466fd0395 for instance 962bba3e-675b-481f-840a-f5d0d2540cb5 on hv-cinder-83699 Jun 03 16:20:56.607064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-f7a41ade-5bf3-4400-af73-5b625b7c9f8f req-1eaae3e2-a83f-42ce-a289-57bfcdda417e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035016 Jun 03 16:20:56.608125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 343/696] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:56.613667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:56.614237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:56.621301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.621783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.622588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:56.623044 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:56.760002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:56.767475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-75458721-bcc4-40eb-bc40-6004b1d7a224 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.163523 Jun 03 16:20:56.768259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 354/697] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:56 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:57.262847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:57.263604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:57.270229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:57.270681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:57.271475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:57.271913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:57.339461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:57.340077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:57.346962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:57.347446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:57.348256 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:57.348783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:57.366456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:20:57.402515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:57.411043 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:57.412569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:57.413703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-370c61e2-d0e0-4f6e-83e4-b494cd701815 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.155649 Jun 03 16:20:57.414264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 344/698] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:57 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:57.478267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:57.486369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1f1a6ec2-fccb-43cb-9936-c8d2efbbe147 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.150718 Jun 03 16:20:57.486932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 355/699] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:57 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:57.784759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:57.785286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:57.791354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:57.791799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:57.792552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:57.792986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:57.922508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:57.930451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-45ee0b89-43ef-4355-aa23-d50c869a76ad tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.149590 Jun 03 16:20:57.931037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 345/700] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:57 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:58.433598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:58.434319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:58.441311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.441875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:58.442645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.443079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:58.505997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:58.506705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:58.513540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.514103 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:58.514945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.515493 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:58.669838 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:58.675595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:58.685925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:58.687608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:58.693572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0b5c3662-ed5a-42fc-8775-1237b62be90d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.193698 Jun 03 16:20:58.694197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 346/701] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:58 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:20:58.695494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ae6c4c28-0f09-4594-a961-257c97cf98df tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.266059 Jun 03 16:20:58.696536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 356/702] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:58 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:20:58.881878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-20fcdbfb-a723-487a-8f19-097ba00490a2 req-a653c886-e6b3-445a-a6d4-e6d235337c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "name": "network-vif-plugged", "status": "completed", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:20:58.889980 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-20fcdbfb-a723-487a-8f19-097ba00490a2 req-a653c886-e6b3-445a-a6d4-e6d235337c47 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.890460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-20fcdbfb-a723-487a-8f19-097ba00490a2 req-a653c886-e6b3-445a-a6d4-e6d235337c47 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:58.901828 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-20fcdbfb-a723-487a-8f19-097ba00490a2 req-a653c886-e6b3-445a-a6d4-e6d235337c47 service nova] Creating event network-vif-plugged:e842e8b9-3bd1-4f5c-ad08-f8f45d991022 for instance a565de36-676c-4b81-ae49-3dfadf4dbd06 on hv-cinder-83699 Jun 03 16:20:58.906603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-20fcdbfb-a723-487a-8f19-097ba00490a2 req-a653c886-e6b3-445a-a6d4-e6d235337c47 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028995 Jun 03 16:20:58.907182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 347/703] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:20:58.948491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:58.949225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:58.955496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.955957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:58.956738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:58.957183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:59.083684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:59.091146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-461834f7-fc35-47c2-9223-db81cc96adee tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.146621 Jun 03 16:20:59.091732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 357/704] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:58 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:59.712133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:59.712894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:59.714449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:20:59.715076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:20:59.719492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:59.719942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:59.720703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:59.721136 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:59.721781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:59.722438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:59.723283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:20:59.723760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:20:59.855926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:59.861392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:59.864825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7ca92c37-4880-4691-9a54-5f0bc7de06b7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.157523 Jun 03 16:20:59.865651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 348/705] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:20:59 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:20:59.870589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:59.872129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:20:59.873275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b6ef6020-0ab7-42e9-9727-11aac8e0309c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.162943 Jun 03 16:20:59.873872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 358/706] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:20:59 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:21:00.108332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:00.108853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:00.115519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:00.115966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:00.117051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:00.117488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:00.245162 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:00.253376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d2be9cc5-55e4-4bb3-aec3-0831622baf35 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.148270 Jun 03 16:21:00.254110 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 349/707] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:00 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:00.881706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:00.882316 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:00.889160 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:00.889642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:00.890420 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:00.890858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:00.890960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:00.891538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:00.898734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:00.899183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:00.899985 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:00.900448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:01.019877 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:01.028088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f3fc59a0-e1fc-4bed-b6d1-12bc63dd5845 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.150121 Jun 03 16:21:01.028655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 359/708] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:00 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:01.032453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:01.036492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:01.042017 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:01.043546 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:01.044688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1ea4f7e5-20ea-46e2-8d0c-2e8d19e0d846 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.157641 Jun 03 16:21:01.045236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 350/709] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:00 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:21:01.270798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:01.271446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:01.277630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:01.278074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:01.278831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:01.279266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:01.410789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:01.418049 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2dbdc827-153e-4d23-a2ce-18b35cfed1f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.151876 Jun 03 16:21:01.418607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 360/710] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:01 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:02.062481 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:02.063092 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:02.069572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:02.069933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:02.070702 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:02.071142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:02.149047 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:02.149687 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:02.151522 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:02.157007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:02.157451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:02.158212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:02.159134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:02.201596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:02.209697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:02.211318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:02.212557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-684e7504-b53b-4c1b-aa7e-5bee2af59f11 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.154649 Jun 03 16:21:02.213192 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 361/711] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:02 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:02.286653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:02.294444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2b511ade-5bfe-4d93-a577-1532ca7449cc tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.252422 Jun 03 16:21:02.295003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 351/712] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:02 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:02.434373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:02.434984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:02.440891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:02.441336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:02.442094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:02.442530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:02.566082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:02.573435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8558b0ce-6d78-4ddc-ac27-acc7c70f4538 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.142842 Jun 03 16:21:02.574000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 362/713] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:02 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:03.230792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:03.231426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:03.234818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:03.239714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:03.240163 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:03.240919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:03.241353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:03.257245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=6 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:03.312119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:03.312736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:03.319793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:03.320454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:03.321026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:03.321469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:03.374123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:03.382600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=6 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:03.382874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:03.384475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:03.385714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-eb2853ac-bf17-4134-be9b-ee0fa3385457 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.158851 Jun 03 16:21:03.386281 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 352/714] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:03 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:03.449741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:03.457866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1a37b5da-3189-4fd8-9c2d-ee0f758ab776 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.149616 Jun 03 16:21:03.458426 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 363/715] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:03 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:03.590649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:03.591271 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:03.597816 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:03.598270 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:03.599035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:03.599513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:03.727569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:03.734872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c05ea0ac-2e5a-49cb-a702-3bc856af7ba4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.148137 Jun 03 16:21:03.735459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 353/716] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:03 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:04.403697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:04.404304 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:04.410444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:04.410895 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:04.411682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:04.412120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:04.474969 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:04.475710 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:04.482156 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:04.482601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:04.483380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:04.483814 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:04.537581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:04.545454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:04.546948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:04.548115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b7223f37-f374-4854-8447-8aa6b0fcfddc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.148408 Jun 03 16:21:04.548676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 364/717] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:04 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:04.609499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:04.618027 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fafd92d9-8d9d-48a6-83a1-c63fabf18292 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.146894 Jun 03 16:21:04.618593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 354/718] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:04 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:04.751816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:04.752425 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:04.758314 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:04.758762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:04.759547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:04.759983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:04.887433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:04.895347 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-db75af6d-4a51-4954-bb63-fcee8a68a8f5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.147235 Jun 03 16:21:04.895909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 365/719] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:04 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:05.566820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:05.567466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:05.573910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:05.574385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:05.575155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:05.575765 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:05.634299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:05.635007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:05.645965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:05.646554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:05.647422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:05.648117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:05.708525 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:05.716384 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:05.717883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:05.719033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b954d837-aabe-4509-ade9-8d251598a736 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.156745 Jun 03 16:21:05.719614 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 355/720] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:05 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:05.774470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:05.782371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b4a15c4a-f881-4c0c-9e56-f969906aabdb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.151982 Jun 03 16:21:05.782918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 366/721] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:05 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:05.912509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:05.913119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:05.919071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:05.919549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:05.920301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:05.920734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:06.049429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:06.056794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a868b683-f43c-4b98-9769-d05057ef5449 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.148570 Jun 03 16:21:06.057357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 356/722] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:05 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:06.738246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:06.738881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:06.745273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:06.745718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:06.746474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:06.746907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:06.801058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:06.801784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:06.808244 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:06.808772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:06.809626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:06.810059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:06.875941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:06.883890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:06.885491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:06.886629 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0ccc149b-be2b-4af7-b33e-762391a94e0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.152714 Jun 03 16:21:06.887063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 367/723] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:06 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:21:06.939545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:06.947359 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-08db1c63-1670-4471-98ff-8a30c90b5681 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.150934 Jun 03 16:21:06.947914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 357/724] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:06 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:07.073192 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:07.073805 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:07.079763 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:07.080715 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:07.081484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:07.081923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:07.209568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:07.217054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-56d8fa43-bb37-4b4b-85f7-3f5972f3dfd2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.147569 Jun 03 16:21:07.217643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 368/725] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:07 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:07.904792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:07.905409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:07.912592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:07.913037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:07.913793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:07.914226 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:07.964682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:07.965292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:07.971721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:07.972759 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:07.973547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:07.973990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:08.043702 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:08.052197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:08.053711 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:08.054871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1ce226d7-98e2-4675-9d8a-53ade4f95701 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.153960 Jun 03 16:21:08.056055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 358/726] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:07 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:08.119004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:08.129714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2a83015a-8f27-4a17-8588-b3ffeb2806ce tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.168742 Jun 03 16:21:08.130647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 369/727] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:07 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:08.233940 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:08.234581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:08.240636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:08.241088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:08.241887 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:08.242384 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:08.367655 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:08.374916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b95919c8-db40-4c8e-90d1-3cf9889717aa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.144879 Jun 03 16:21:08.375512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 359/728] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:08 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:09.073109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:09.073659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:09.080148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:09.080599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:09.081871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:09.082310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:09.148279 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:09.148898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:09.155183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:09.155660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:09.156436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:09.156855 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:09.214674 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:09.226072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:09.228382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:09.229590 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b5266bf2-8c74-4a92-8eaa-68eae3a3c0c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.160393 Jun 03 16:21:09.230452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 370/729] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:09 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:09.292668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:09.300756 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e30f5723-d80c-45ac-ac78-4272319332b0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.157128 Jun 03 16:21:09.301400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 360/730] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:09 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:09.392034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:09.392654 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:09.399418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:09.399872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:09.400639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:09.401079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:09.527497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:09.534865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-383a4b09-5714-4824-bed6-ad773467318f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.146689 Jun 03 16:21:09.535432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 371/731] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:09 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:10.247763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:10.248352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:10.254848 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:10.255310 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:10.256078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:10.256511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:10.317607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:10.318317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:10.324869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:10.325422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:10.326270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:10.326778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:10.330970 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:10.385376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:10.393425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:10.395096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:10.396291 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-867bd755-e4e1-4891-985a-eaab7bdaf6f1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.152396 Jun 03 16:21:10.403688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 361/732] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:10 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:10.457125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:10.465185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7fe55398-8deb-4fd4-90a6-8a429beb2326 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.151359 Jun 03 16:21:10.465785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 372/733] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:10 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:10.551962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:10.552529 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:10.558446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:10.558894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:10.559687 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:10.560131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:10.685938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:10.693294 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0708944d-194a-4545-b97c-b11fcaadc8f6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.145750 Jun 03 16:21:10.693862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 362/734] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:10 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:11.414211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:11.414874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:11.421318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:11.421769 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:11.422533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:11.422972 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:11.482587 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:11.483433 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:11.490453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:11.490908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:11.491723 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:11.492153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:11.553659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:11.561669 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:11.563221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:11.564436 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bfa9974b-2511-48eb-bad8-949cfb5eb493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.154105 Jun 03 16:21:11.564993 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 373/735] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:11 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:21:11.617957 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:11.625806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b295fa0b-2fcd-4702-abcc-15d91eb04a39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.147198 Jun 03 16:21:11.626367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 363/736] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:11 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:11.710189 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:11.710746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:11.716789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:11.717242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:11.718017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:11.718462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:11.842117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:11.849607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f53ea340-4c74-458a-8675-551af36c4277 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.143864 Jun 03 16:21:11.850171 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 374/737] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:11 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:12.583969 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:12.584533 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:12.591028 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:12.591517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:12.592310 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:12.592752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:12.642731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:12.643497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:12.650731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:12.651173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:12.651969 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:12.652405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:12.724055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:12.731971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:12.733491 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:12.734657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-582f3b7a-985f-4a14-83c2-95d2176416f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.155377 Jun 03 16:21:12.735216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 364/738] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:12 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:12.783158 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:12.791097 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c3a5f417-7c1a-4526-90a6-15531e014db7 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.152218 Jun 03 16:21:12.791692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 375/739] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:12 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:12.866681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:12.867286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:12.873269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:12.873894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:12.874664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:12.875105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:13.000319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:13.007884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-22de4aa0-405a-4f79-b9ca-ec69d3970280 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.145592 Jun 03 16:21:13.008453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 365/740] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:12 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:13.751978 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:13.752586 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:13.759082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:13.759562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:13.760328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:13.760765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:13.808269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:13.808865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:13.815592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:13.816037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:13.816799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:13.817233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:13.889015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:13.897814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:13.899207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:13.900584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c5384c82-2a91-4cab-b4ea-8ed20739ce7c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.152457 Jun 03 16:21:13.901146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 376/741] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:13 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:13.950659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:13.959065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7cfff34a-b769-4b01-bf20-654b9608c10e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.154732 Jun 03 16:21:13.959665 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 366/742] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:13 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:14.025419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:14.025973 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:14.031996 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:14.032453 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:14.033236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:14.033677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:14.161054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:14.168635 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-51ab5809-3314-4826-bf32-0ea6fd51d778 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.147359 Jun 03 16:21:14.169232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 377/743] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:14 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:14.919211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:14.919785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:14.926654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:14.927094 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:14.927880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:14.928316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:14.947815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:14.976823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:14.977445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:14.984002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:14.984458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:14.985231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:14.985666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:15.077489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:15.086404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:15.089402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:15.091045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9d7df83c-14df-47d2-9e8a-4b85ea1be30f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.175886 Jun 03 16:21:15.091995 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 367/744] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:14 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:15.119575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:15.127444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-41a51658-65c7-4f0d-bb28-c36869454e76 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1723 microversion: 2.1 time: 0.154689 Jun 03 16:21:15.128028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 378/745] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:14 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:15.184823 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:15.185431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:15.191353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:15.191800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:15.192548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:15.192979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:15.316793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:15.324091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cdd32b73-6d03-4466-a65b-4263c0740a6e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.143074 Jun 03 16:21:15.324648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 368/746] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:15 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:16.109688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:16.110298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:16.117421 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.117872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.118640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.119081 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.144549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:16.145485 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:16.151984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.152433 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.153436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.153907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.250004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:16.259876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:16.261391 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:16.262562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-03d67ae6-58b8-4a29-98aa-397daf768f20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.156837 Jun 03 16:21:16.263113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 379/747] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:16 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:16.297872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:16.306967 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9648642f-ce05-41f4-941f-e3e0dfd06aa9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1700 microversion: 2.1 time: 0.166205 Jun 03 16:21:16.307593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 369/748] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:16 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:16.323275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-125e17c1-705e-4c39-bb56-e4036650195d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:16.329545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-125e17c1-705e-4c39-bb56-e4036650195d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.330005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-125e17c1-705e-4c39-bb56-e4036650195d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.340792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:16.341398 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:16.347850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.348374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.349387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.349824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.389581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-125e17c1-705e-4c39-bb56-e4036650195d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Going to try to start instance {{(pid=117571) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 16:21:16.432102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-125e17c1-705e-4c39-bb56-e4036650195d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action" status: 202 len: 0 microversion: 2.1 time: 0.112606 Jun 03 16:21:16.432898 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 380/749] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:21:16 2022] POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 16:21:16.442201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:16.442934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:16.449825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.450317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.451196 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:16.451678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:16.492779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:16.503111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-106f985e-1acf-43db-a56d-82dcbcb59b7a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.165844 Jun 03 16:21:16.506643 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 370/750] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:16 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:16.853237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:16.861277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fae19c11-62c7-4231-9568-0dd7c556794d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1709 microversion: 2.1 time: 0.423187 Jun 03 16:21:16.861842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 381/751] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:16 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1709 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:17.282223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:17.282846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:17.289355 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.289814 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.290616 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.291058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.397888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-d4e36e47-0567-4bd1-b316-297c27fc0ffd req-8fdf96df-76d2-4221-9c50-913ee5db653b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962bba3e-675b-481f-840a-f5d0d2540cb5", "name": "network-vif-plugged", "status": "completed", "tag": "d868f766-fcef-4abb-aaea-7f4466fd0395"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:17.406838 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-d4e36e47-0567-4bd1-b316-297c27fc0ffd req-8fdf96df-76d2-4221-9c50-913ee5db653b service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.407272 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-d4e36e47-0567-4bd1-b316-297c27fc0ffd req-8fdf96df-76d2-4221-9c50-913ee5db653b service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.419203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-d4e36e47-0567-4bd1-b316-297c27fc0ffd req-8fdf96df-76d2-4221-9c50-913ee5db653b service nova] Creating event network-vif-plugged:d868f766-fcef-4abb-aaea-7f4466fd0395 for instance 962bba3e-675b-481f-840a-f5d0d2540cb5 on hv-cinder-83699 Jun 03 16:21:17.422452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:17.424411 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-d4e36e47-0567-4bd1-b316-297c27fc0ffd req-8fdf96df-76d2-4221-9c50-913ee5db653b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030237 Jun 03 16:21:17.425529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 382/752] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:21:17.431427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:17.433003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:17.434331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-58147495-369e-4a34-bc4f-6d6b76b88b53 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1742 microversion: 2.20 time: 0.156549 Jun 03 16:21:17.435124 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 371/753] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:17 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:17.520864 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:17.521630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:17.527993 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.528446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.529211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.529651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.663304 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:17.670653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-41ff19d3-8403-4a66-a916-a866c9fa988f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.154581 Jun 03 16:21:17.671214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 383/754] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:17 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:17.691542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:17.692037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:17.697956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.698402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.699156 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.699628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.820220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lazy-loading 'services' on Instance uuid 42eb67eb-b939-4633-bea4-2cc1db4b7f1d {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:21:17.878740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:17.879382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:17.885694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.886145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:17.886964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:17.887428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:18.020307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:18.028523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-192e2fe0-1f65-42d6-a860-9a553a2c7f39 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1709 microversion: 2.1 time: 0.154239 Jun 03 16:21:18.029083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 384/755] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:17 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:21:18.088149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0794698b-0875-4c4e-b630-5b8a2f5f396a tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "DELETE /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d/os-volume_attachments/06192d53-b558-416a-b5bb-b80738bcb52e" status: 202 len: 0 microversion: 2.1 time: 0.400366 Jun 03 16:21:18.088948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 372/756] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:21:17 2022] DELETE /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d/os-volume_attachments/06192d53-b558-416a-b5bb-b80738bcb52e => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:21:18.451735 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:18.452343 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:18.459212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:18.459697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:18.460456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:18.460890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:18.587522 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:18.595276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:18.596789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:18.597937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ad604b0f-0831-49e9-a5fd-c6462842fd8e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.150057 Jun 03 16:21:18.598483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 385/757] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:18 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:18.688150 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:18.688850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:18.700518 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:18.700970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:18.701755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:18.702173 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:18.848300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:18.855912 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9862d471-9442-4035-845b-077f9b359f37 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.172461 Jun 03 16:21:18.856466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 373/758] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:18 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:19.046033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:19.046608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:19.053233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:19.053685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:19.054454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:19.054895 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:19.184989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:19.193640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9bb76a57-6400-4a41-833b-d1142d966cb5 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1713 microversion: 2.1 time: 0.151470 Jun 03 16:21:19.194203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 386/759] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:19 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:19.616101 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:19.616745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:19.624181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:19.624635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:19.625414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:19.625852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:19.759487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:19.775694 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:19.777322 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:19.778722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-20af99a5-664c-4e59-9d75-a08fc803c1bc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.166408 Jun 03 16:21:19.779738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 374/760] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:19 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:19.873634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:19.874188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:19.880154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:19.880789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:19.881719 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:19.882313 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.020786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:20.031346 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b2c03969-58d9-4b0a-8a05-d1fb7bcfb26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.162109 Jun 03 16:21:20.032150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 387/761] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:19 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:20.261827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:20.262337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:20.268881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:20.269532 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.270299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:20.270740 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.295701 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:21:20.393575 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-be1e7cff-25a5-49db-bda5-d20afb19a53b tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "DELETE /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 204 len: 0 microversion: 2.1 time: 0.134982 Jun 03 16:21:20.394181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 375/762] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:21:20 2022] DELETE /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:21:20.402671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:20.403282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:20.410057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:20.410500 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.411276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:20.411715 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.431735 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:20.557942 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:20.567439 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fdc83fcf-0ace-4afb-9c5e-cc22cb4322f5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1560 microversion: 2.1 time: 0.168480 Jun 03 16:21:20.568002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 388/763] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:20 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:20.798609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:20.800600 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:20.808050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:20.808531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.809307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:20.809745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:20.950789 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:20.959370 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:20.961735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:20.963077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-043aa297-237d-4b12-969a-03a269172d76 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.168868 Jun 03 16:21:20.963820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 376/764] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:20 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:21.048338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:21.049021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:21.056032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:21.056483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:21.057258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:21.057696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:21.231477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:21.240902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c4e94004-8a89-4618-acd9-d37c589f314b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.196467 Jun 03 16:21:21.241602 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 389/765] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:21 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:21.594078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:21.596332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:21.602606 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:21.603329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:21.604475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:21.605006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:21.737714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:21.747612 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-430b5cd8-3ba9-4d52-b09f-1ae5e16dfe6f tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1514 microversion: 2.1 time: 0.164454 Jun 03 16:21:21.748516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 377/766] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:21 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:21.981809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:21.982748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:21.989248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:21.989954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:21.990487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:21.990926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:22.123222 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:22.131928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:22.133430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:22.134795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a53713ff-71f3-4f9d-b454-713409c458fa tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.156954 Jun 03 16:21:22.135362 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 390/767] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:21 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:21:22.259180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:22.259834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:22.265807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:22.266261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:22.267222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:22.267919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:22.469792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:22.477590 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f8423ea3-a25d-41e2-91c1-60efeb7843b6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1366 microversion: 2.1 time: 0.222867 Jun 03 16:21:22.478146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 378/768] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:22 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:22.766290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:22.766891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:22.773238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:22.773688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:22.774449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:22.774885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:22.929372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:22.936962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ce2d1a83-c687-4498-ab77-8ff122d3bf6e tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1514 microversion: 2.1 time: 0.174540 Jun 03 16:21:22.937520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 391/769] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:22 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:23.154613 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:23.155520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:23.162966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.163452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.164261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.165242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.329165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:23.337873 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:23.339520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:23.340690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-043f3f27-0ea0-49e7-bea3-482c8634598d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.192065 Jun 03 16:21:23.341254 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 379/770] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:23 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:23.494736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:23.495930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:23.504644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.505739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.507169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.507851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.749661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:23.759955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ae4e7935-0b73-4867-b544-9597ea8258fb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1556 microversion: 2.1 time: 0.269822 Jun 03 16:21:23.760525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 392/771] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:23 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1556 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:23.779453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:23.779958 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:23.788079 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.790077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.791235 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.793021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.876911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7b3d762a-967e-413b-8577-4c07bfb26a4c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101922 Jun 03 16:21:23.878006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 380/772] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:21:23 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:21:23.959253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:23.959967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:23.976223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.976681 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:23.982737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:23.983209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:24.126034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a595db7f394c7e86b6a9e0c9f625f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b5c201aae5e438c81d8976289ffb4cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:24.135165 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-68edaba3-d0ad-4322-91cd-df12e92da502 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 200 len: 1472 microversion: 2.1 time: 0.182149 Jun 03 16:21:24.136897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 393/773] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:23 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:21:24.171175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-23d8e2af-89a5-4a6e-a759-1dd6caa7d186 req-0a7e88ee-211d-43ea-979c-13c87bec20d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb67eb-b939-4633-bea4-2cc1db4b7f1d", "name": "network-vif-deleted", "tag": "a82127a2-5b2e-49b0-88b4-20b967cc8d05"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:24.184360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-23d8e2af-89a5-4a6e-a759-1dd6caa7d186 req-0a7e88ee-211d-43ea-979c-13c87bec20d1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:24.185053 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-23d8e2af-89a5-4a6e-a759-1dd6caa7d186 req-0a7e88ee-211d-43ea-979c-13c87bec20d1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:24.204628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-23d8e2af-89a5-4a6e-a759-1dd6caa7d186 req-0a7e88ee-211d-43ea-979c-13c87bec20d1 service nova] Creating event network-vif-deleted:a82127a2-5b2e-49b0-88b4-20b967cc8d05 for instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d on hv-cinder-83699 Jun 03 16:21:24.219908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-23d8e2af-89a5-4a6e-a759-1dd6caa7d186 req-0a7e88ee-211d-43ea-979c-13c87bec20d1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052586 Jun 03 16:21:24.226488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 381/774] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:21:24.364964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:24.366035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:24.373638 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:24.374650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:24.376079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:24.376869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:24.523455 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:24.532258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:24.533783 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:24.535419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0b05e886-c365-4f66-8fc1-09c793444531 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.174812 Jun 03 16:21:24.536164 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 394/775] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:24 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:25.051658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-5c1c7a5d-138b-442a-a1f1-e71c5de0ac29 req-2f854b9a-7b92-4aa9-b682-4bf4133d2c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "962bba3e-675b-481f-840a-f5d0d2540cb5", "tag": "d868f766-fcef-4abb-aaea-7f4466fd0395"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:25.066818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5c1c7a5d-138b-442a-a1f1-e71c5de0ac29 req-2f854b9a-7b92-4aa9-b682-4bf4133d2c2b service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:25.067272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5c1c7a5d-138b-442a-a1f1-e71c5de0ac29 req-2f854b9a-7b92-4aa9-b682-4bf4133d2c2b service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:25.085220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-5c1c7a5d-138b-442a-a1f1-e71c5de0ac29 req-2f854b9a-7b92-4aa9-b682-4bf4133d2c2b service nova] Creating event network-changed:d868f766-fcef-4abb-aaea-7f4466fd0395 for instance 962bba3e-675b-481f-840a-f5d0d2540cb5 on hv-cinder-83699 Jun 03 16:21:25.091374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-5c1c7a5d-138b-442a-a1f1-e71c5de0ac29 req-2f854b9a-7b92-4aa9-b682-4bf4133d2c2b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111455 Jun 03 16:21:25.092536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 382/776] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:21:25.156240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:25.157267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] [instance: 42eb67eb-b939-4633-bea4-2cc1db4b7f1d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:25.166207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:25.167600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:25.168845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:25.169438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:25.188641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] HTTP exception thrown: Instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d could not be found. Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Request method failure captured: Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d HTTP/1.1 Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjRlVX1mz5D59bt5AGf5J8BD6LWB4dEy1uhlORBBcz7MeunHQS_1Kb3TBde974BxUapms6t5bi3hfdWz90zxTvxajRab9L9kNvF2poLRJqPOYQQkLZ1VhAnjxH9DMycVj6zxeFtJGWorb6XJP93lDFblVzVmW2e4wae4wAXLxoH4_vE Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 1b5c201aae5e438c81d8976289ffb4cb Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2076250543 Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:21:25.190364 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1b5c201aae5e438c81d8976289ffb4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1b5c201aae5e438c81d8976289ffb4cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1b5c201aae5e438c81d8976289ffb4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1b5c201aae5e438c81d8976289ffb4cb"}]}] Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesSnapshotTestJSON-2076250543 Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 1b5c201aae5e438c81d8976289ffb4cb Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2076250543 Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesSnapshotTestJSON-2076250543-project Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 12a595db7f394c7e86b6a9e0c9f625f8 Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesSnapshotTestJSON-2076250543-project Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d could not be found. Jun 03 16:21:25.192030 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '42eb67eb-b939-4633-bea4-2cc1db4b7f1d'} Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d could not be found. Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:21:25.193042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d could not be found. Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d could not be found. Jun 03 16:21:25.194512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:21:25.196777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] Returning 404 to user: Instance 42eb67eb-b939-4633-bea4-2cc1db4b7f1d could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:21:25.197781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d6d9eb50-5661-4d44-8841-fe66778e1aa5 tempest-VolumesSnapshotTestJSON-2076250543 tempest-VolumesSnapshotTestJSON-2076250543-project] 10.222.0.41 "GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d" status: 404 len: 111 microversion: 2.1 time: 0.047449 Jun 03 16:21:25.198999 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 395/777] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:21:25 2022] GET /compute/v2.1/servers/42eb67eb-b939-4633-bea4-2cc1db4b7f1d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:21:25.555386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:25.556247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:25.570510 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:25.572790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:25.574021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:25.575826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:25.616074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:25.758200 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:25.767762 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:25.769542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:25.771513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-41ccdf0e-e742-49c1-ad12-dba8eab2a942 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.221057 Jun 03 16:21:25.772821 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 383/778] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:25 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:26.790721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:26.791384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:26.801269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=86 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:26.809119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:26.809628 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:26.810557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:26.810885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:26.961760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:26.972797 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:26.975555 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:26.977251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-640dac2d-eda4-4c7b-ba49-beb596f310cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.191042 Jun 03 16:21:26.978380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 396/779] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:26 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:27.996360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:27.996970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:28.003770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:28.004220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:28.005044 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:28.005977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:28.141096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:28.149913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:28.151582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:28.152889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2518a1c6-47a2-4100-9054-6a8ccab03b41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.160410 Jun 03 16:21:28.153454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 384/780] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:27 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:29.182067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:29.183273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:29.193516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:29.194086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:29.194881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:29.195342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:29.354958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:29.364288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:29.365281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:29.366737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8e6350e5-a047-4342-96cd-df3bf5e0502a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.198774 Jun 03 16:21:29.377323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 397/781] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:29 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:30.385724 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:30.386444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:30.393229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:30.393758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:30.394549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:30.394921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:30.547366 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:30.556248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:30.557812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:30.559062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-281e7910-979f-4f36-ab9d-c43e8b659b05 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.177605 Jun 03 16:21:30.559676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 385/782] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:30 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:31.577812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:31.578356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:31.584820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:31.585270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:31.586033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:31.586466 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:31.709542 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:31.717326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:31.718821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:31.719986 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ffe149db-f345-41ca-a974-fce3e830ebeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1737 microversion: 2.20 time: 0.146075 Jun 03 16:21:31.720537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 398/783] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:31 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:32.737892 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:32.738507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:32.740890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:32.746201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:32.746696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:32.747456 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:32.748023 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:32.875690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:32.884142 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:32.885651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:32.886822 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6645dfab-624a-4def-8469-8db14ccb276c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1719 microversion: 2.20 time: 0.152847 Jun 03 16:21:32.887400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 386/784] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:32 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:33.906131 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:33.906749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:33.914147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:33.914608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:33.915427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:33.915873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:34.041081 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:34.048881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:34.050373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:34.051547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c3bcf800-8d65-49ac-8e03-0445533c83ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1719 microversion: 2.20 time: 0.149282 Jun 03 16:21:34.052136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 399/785] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:33 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:35.070143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:35.070752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:35.077310 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:35.077751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:35.078508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:35.078942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:35.211767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:35.220157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:35.221803 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:35.223058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0e3d477f-67ab-428e-bb3f-c3286cdcd017 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1719 microversion: 2.20 time: 0.157328 Jun 03 16:21:35.223678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 387/786] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:35 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:36.241317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:36.241955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:36.248221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.248668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.249432 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.249869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.377711 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:36.386037 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:36.387556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:36.388695 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e3a2c0a3-3029-443b-b218-da974dbc720c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1662 microversion: 2.20 time: 0.151276 Jun 03 16:21:36.389245 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 400/787] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:36 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:36.407120 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cec29d9d-5fd3-4acd-972d-68fbbb20ddd2"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:36.408245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:36.414734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.415184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.416100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.416548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.684007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8a7678ab-c652-44d1-b9ec-f0c442bcc5cc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280829 Jun 03 16:21:36.684598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 388/788] 10.222.0.41 () {62 vars in 1363 bytes} [Fri Jun 3 16:21:36 2022] POST /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:21:36.804429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:36.805004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:36.810945 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.811443 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.812222 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.812666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.941503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d89fb9f2-9167-450f-a673-7af842820e89 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/action" status: 202 len: 0 microversion: 2.20 time: 0.141723 Jun 03 16:21:36.942199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 401/789] 10.222.0.41 () {62 vars in 1318 bytes} [Fri Jun 3 16:21:36 2022] POST /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:21:36.951126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:36.951860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:36.958855 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.959588 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:36.960538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:36.960988 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:37.094791 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:37.103337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:37.104947 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:37.106199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-87c25f23-ae63-4694-8454-7bab5dfa28b2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1748 microversion: 2.20 time: 0.159111 Jun 03 16:21:37.106838 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 389/790] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:36 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:38.125692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:38.126311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:38.132875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:38.133336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:38.134107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:38.134551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:38.260203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:38.268472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:38.269967 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:38.271187 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6e864133-eb89-483b-9e5e-df1e631a6779 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1748 microversion: 2.20 time: 0.149866 Jun 03 16:21:38.272012 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 402/791] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:38 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:38.763811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-60e8f74e-4662-412c-bd6f-f7db8773540f req-9429d313-d423-4a7b-b48d-a6d3eb1158e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "name": "network-vif-unplugged", "status": "completed", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:21:38.773424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-60e8f74e-4662-412c-bd6f-f7db8773540f req-9429d313-d423-4a7b-b48d-a6d3eb1158e2 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:38.773875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-60e8f74e-4662-412c-bd6f-f7db8773540f req-9429d313-d423-4a7b-b48d-a6d3eb1158e2 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:38.785199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.compute.server_external_events [req-60e8f74e-4662-412c-bd6f-f7db8773540f req-9429d313-d423-4a7b-b48d-a6d3eb1158e2 service nova] Unable to find a host for instance a565de36-676c-4b81-ae49-3dfadf4dbd06. Dropping event network-vif-unplugged {{(pid=117570) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 16:21:38.786637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-60e8f74e-4662-412c-bd6f-f7db8773540f req-9429d313-d423-4a7b-b48d-a6d3eb1158e2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.079592 Jun 03 16:21:38.787169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 390/792] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 81 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 16:21:39.290791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:39.291367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:39.297806 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:39.298266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:39.299074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:39.299549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:39.431185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:39.439606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:39.441116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:39.442249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dfc13735-c688-4828-8adf-1010c3501079 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1750 microversion: 2.20 time: 0.155988 Jun 03 16:21:39.442793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 403/793] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:39 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:40.461168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:40.461775 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:40.468245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:40.468685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:40.469439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:40.469871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:40.595518 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:40.604381 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:40.605877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:40.607027 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ecdd2753-4e03-4b16-8ab2-a9deffccb44b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1750 microversion: 2.20 time: 0.149892 Jun 03 16:21:40.607609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 391/794] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:40 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:41.624791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:41.625410 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:41.632039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:41.632496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:41.633266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:41.633706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:41.759748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:41.763116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:41.769002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:41.770512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:41.772539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-33bf0196-ae32-4404-b848-74d3b0d3a9b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1750 microversion: 2.20 time: 0.151583 Jun 03 16:21:41.773092 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 404/795] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:41 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:42.792184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:42.792819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:42.799754 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:42.800333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:42.801444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:42.801966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:42.940093 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:42.948831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:42.950417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:42.951609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7c8a0483-e20d-4210-a9d4-e14e1d492f6b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1750 microversion: 2.20 time: 0.165563 Jun 03 16:21:42.952164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 392/796] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:42 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:43.970433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:43.971044 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:43.978823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:43.979273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:43.980086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:43.980522 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:44.115160 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:44.123798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:44.125296 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:44.126438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4aab44de-f42e-4346-a029-75abdec80a6c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.160102 Jun 03 16:21:44.126991 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 405/797] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:43 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:21:45.145237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:45.145853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:45.153064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:45.153424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:45.154202 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:45.154688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:45.304580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:45.312818 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:45.314316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:45.315497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6be794fd-b20c-465b-aacc-84317617bf5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.174180 Jun 03 16:21:45.316058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 393/798] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:45 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:46.335451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:46.336947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:46.343822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:46.344276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:46.345058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:46.345497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:46.473004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:46.481397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:46.482885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:46.484062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bf97e329-c11d-44a2-bdb3-cf05014179f5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.153514 Jun 03 16:21:46.484618 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 406/799] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:46 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:47.502086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:47.502602 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:47.509487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:47.509945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:47.510715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:47.511160 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:47.637112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:47.645673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:47.648240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:47.649410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4d52cc5f-5101-46bf-9e31-9a28e2f1d6fe tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.151365 Jun 03 16:21:47.649965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 394/800] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:47 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:48.668987 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:48.669593 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:48.676175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:48.676612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:48.677379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:48.677811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:48.815207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:48.825193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:48.826979 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:48.828183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8603f37f-16ba-480e-a6bb-8dd429b03df6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.163077 Jun 03 16:21:48.828728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 407/801] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:48 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:49.846409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:49.847125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:49.854037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:49.854487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:49.855256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:49.855719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:49.995708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:50.004986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:50.007256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:50.008820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ff9fa16c-d126-484e-8503-7f8107e79b73 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.166413 Jun 03 16:21:50.009545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 395/802] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:49 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:51.026966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:51.027608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:51.034185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:51.034639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:51.035452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:51.035897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:51.166781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:51.176180 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:51.178829 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:51.180578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ab50bfcf-fda5-4238-92f3-d43c34b07e93 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.157337 Jun 03 16:21:51.181295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 408/803] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:51 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:52.198884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:52.199537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:52.206112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:52.206561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:52.207353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:52.207800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:52.359768 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:52.368888 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:52.370404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:52.371624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e344265c-ba5a-42ba-8289-fca313930a3c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.176650 Jun 03 16:21:52.372183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 396/804] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:52 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:52.437115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:21:52.437357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:21:53.392347 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:53.394441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:53.403976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:53.404441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:53.405238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:53.405679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:53.566035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:53.576960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:53.579147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:53.581283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b219d64c-279b-4ae6-a995-3c04138027a9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.195356 Jun 03 16:21:53.582384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 409/805] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:53 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:54.601764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:54.602378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:54.609025 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:54.609477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:54.610255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:54.610693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:54.785802 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:54.796001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:54.797515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:54.798712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-16ab7b16-ab7f-4b2f-97f1-72e225611b18 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.201856 Jun 03 16:21:54.799265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 397/806] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:54 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:55.816676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:55.818020 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:55.827172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:55.828068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:55.829098 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:55.829706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:56.011169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:56.021210 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:56.024076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:56.025766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-95d785ff-bc8e-4fce-95e8-a23332e1fe92 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.213032 Jun 03 16:21:56.038196 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 410/807] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:55 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:57.046777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:57.047460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:57.055371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:57.056180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:57.056977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:57.057421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:57.060311 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:57.314086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:57.330231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:57.333338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:57.334810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-36722afa-11d9-43d7-aa51-6fe1b00b70d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.293616 Jun 03 16:21:57.335489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 398/808] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:57 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:58.353585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:58.354254 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:58.356692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=32 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:21:58.363879 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:58.365108 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:58.366089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:58.366719 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:58.522699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:58.531521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:58.533148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:58.534519 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fda0e330-ea5c-4fc8-9300-e9761406bfae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.184844 Jun 03 16:21:58.535249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 411/809] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:58 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:21:59.554755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:21:59.556192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:21:59.564365 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:59.565847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:59.566411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:21:59.567026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:21:59.715547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:59.725618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:59.727544 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:21:59.728901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-73de096e-2f31-48ee-a101-6a15603b5e8c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.178828 Jun 03 16:21:59.736462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 399/810] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:21:59 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:00.747356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:00.748611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:00.756106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:00.756810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:00.757760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:00.758358 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:00.898878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:00.908729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:00.911413 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:00.912942 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fcd8f05d-e4a7-44d6-b914-2c0d4c3a6318 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.169844 Jun 03 16:22:00.913667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 412/811] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:00 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:22:01.932541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:01.934560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:01.942808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:01.943851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:01.945086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:01.945794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:02.208592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:02.222352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:02.235255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:02.239686 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-78f8654f-662c-4ef5-b429-502a26269ec8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.310533 Jun 03 16:22:02.263489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 400/812] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:01 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:03.263009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:03.263677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:03.291542 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:03.291870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:03.292730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:03.293181 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:04.025274 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:04.045106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:04.051822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:04.056418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4775d113-43f0-46db-836b-9981908b1c31 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.801805 Jun 03 16:22:04.060542 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 413/813] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:03 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:05.078131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:05.079007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:05.081549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=30 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:05.087034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:05.087737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:05.088660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:05.089110 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:05.229948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:05.245709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:05.247265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:05.250823 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5e77c27d-1389-4e97-8cac-af7d0fc8a42e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.176723 Jun 03 16:22:05.252107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 401/814] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:05 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:06.269176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:06.270297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:06.276922 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:06.277315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:06.278097 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:06.278538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:06.442919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:06.453259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:06.455310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:06.457256 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f7bbc446-be38-4db5-81c1-aebce0cb9237 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.192312 Jun 03 16:22:06.458575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 414/815] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:06 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:07.477078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:07.477748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:07.485089 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:07.485860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:07.486901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:07.487557 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:07.689577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:07.703535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:07.705737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:07.708122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1384be84-2b8b-4168-96fe-2cbe2c4487e8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.234971 Jun 03 16:22:07.720481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 402/816] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:07 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:08.729888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:08.730483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:08.737677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:08.738135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:08.739440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:08.740039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:08.906883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:08.916275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:08.918249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:08.922006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-77b7e2ef-a88a-4501-934c-66b371fc37b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.193913 Jun 03 16:22:08.922990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 415/817] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:08 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:09.941177 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:09.942896 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:09.952913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:09.953798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:09.954586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:09.955029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:10.145107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:10.158550 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:10.161628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:10.163108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7e0716af-3f49-46e2-a572-98120436a36c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.226239 Jun 03 16:22:10.164256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 403/818] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:09 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:11.181508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:11.183993 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:11.194760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:11.195154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:11.195975 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:11.196521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:11.345128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:11.354159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:11.356399 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:11.357793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-876a099c-5007-4e6a-9182-504e1e93dfda tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.179927 Jun 03 16:22:11.358147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 416/819] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:11 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:12.345415 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-30e277e8-b982-45b9-8ed2-c108bffa2831 req-eaf1980d-d02c-4c3c-9401-a6a097a87c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "name": "network-vif-plugged", "status": "completed", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:12.354790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-30e277e8-b982-45b9-8ed2-c108bffa2831 req-eaf1980d-d02c-4c3c-9401-a6a097a87c00 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:12.355437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-30e277e8-b982-45b9-8ed2-c108bffa2831 req-eaf1980d-d02c-4c3c-9401-a6a097a87c00 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:12.376897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:12.377578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:12.380610 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-30e277e8-b982-45b9-8ed2-c108bffa2831 req-eaf1980d-d02c-4c3c-9401-a6a097a87c00 service nova] Creating event network-vif-plugged:e842e8b9-3bd1-4f5c-ad08-f8f45d991022 for instance a565de36-676c-4b81-ae49-3dfadf4dbd06 on hv-cinder-83699 Jun 03 16:22:12.388456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:12.389268 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:12.390291 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:12.390953 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:12.397518 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-30e277e8-b982-45b9-8ed2-c108bffa2831 req-eaf1980d-d02c-4c3c-9401-a6a097a87c00 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054385 Jun 03 16:22:12.398984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 404/820] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:12.562427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:12.573929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:12.575450 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:12.576603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ca4cc5c5-240e-4bef-8e68-71689acbf4ed tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.204448 Jun 03 16:22:12.577163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 417/821] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:12 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:13.596909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:13.597556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:13.604570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:13.605021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:13.605796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:13.606232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:13.746630 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:13.756124 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:13.757651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:13.758845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5ad20f82-bcbe-4ba3-9c36-60e5f82bebad tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.166487 Jun 03 16:22:13.769370 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 405/822] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:13 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:14.243198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-77dd48cd-c396-4864-8b89-cd2b0301ade7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Action: 'create', calling method: .version_select at 0x7fb5c5d995e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-914771560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8stP82SnWBh5hbFC1PNUjEpKSJxyUHB/M/CMUd3aMmrf8Nf0y0+Avm9eKMEeyWBsHgy1DsAuW0kjs+YA2TP/qurS2Nq2LI6eYH6xKqK1DKFJzceHTTYercNSL/aJshXw=="}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:14.257636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-77dd48cd-c396-4864-8b89-cd2b0301ade7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Getting quotas for project 566b367dc7504d3091558cfd6f35bfa9. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:22:14.261907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-77dd48cd-c396-4864-8b89-cd2b0301ade7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Getting quotas for user 1e415e30c70d441991187b13c229ee18 and project 566b367dc7504d3091558cfd6f35bfa9. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:22:14.284331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-77dd48cd-c396-4864-8b89-cd2b0301ade7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044968 Jun 03 16:22:14.284949 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 418/823] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:22:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:14.386473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-872807132", "imageRef": "447cc8b1-141f-4beb-89df-235e43e36756", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-914771560", "networks": [{"uuid": "41e43258-6f06-4a8a-b481-042e12142b50"}]}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:14.440863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] validate_networks() for [('41e43258-6f06-4a8a-b481-042e12142b50', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:22:14.777478 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:14.778247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:14.784665 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:14.785223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:14.793419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:14.794014 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:14.799916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=79 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:14.815674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:22:14.816096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:22:14.818300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:22:14.818300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:22:14.818300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:22:14.835217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:14.835719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:14.836854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:14.837314 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:14.856507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Getting quotas for project 566b367dc7504d3091558cfd6f35bfa9. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:22:14.860927 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Getting quotas for user 1e415e30c70d441991187b13c229ee18 and project 566b367dc7504d3091558cfd6f35bfa9. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:22:14.873074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:22:14.875346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='447cc8b1-141f-4beb-89df-235e43e36756',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:22:14.933170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ad00827e-727f-4035-b0ac-1f1a6e382866 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551024 Jun 03 16:22:14.933824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 406/824] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:22:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:22:14.943909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2730e18c-a5a0-4d19-8be6-6bc0cedc4ae3 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:14.944529 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2730e18c-a5a0-4d19-8be6-6bc0cedc4ae3 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:14.955190 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:14.971997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:14.973751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:14.975193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c9de6ce1-b83d-4692-ba25-44f2fb73a308 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1806 microversion: 2.20 time: 0.201929 Jun 03 16:22:14.976288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 419/825] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:14 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:22:15.005851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2730e18c-a5a0-4d19-8be6-6bc0cedc4ae3 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:15.014376 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2730e18c-a5a0-4d19-8be6-6bc0cedc4ae3 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1257 microversion: 2.1 time: 0.074713 Jun 03 16:22:15.015440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 407/826] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:14 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:15.996442 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:15.997337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:16.003737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:16.004187 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:16.004960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:16.006024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:16.032358 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:16.033746 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:16.041372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:16.041939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:16.042718 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:16.043155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:16.112895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:16.120747 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fdcf59ba-59eb-4fd0-baf0-73f3224eb963 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1327 microversion: 2.1 time: 0.092814 Jun 03 16:22:16.121529 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 408/827] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:16 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:16.228337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:16.238209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:16.240691 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:16.242476 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-98554616-f802-4d83-877a-4ed3aeced58b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1793 microversion: 2.20 time: 0.250004 Jun 03 16:22:16.242761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 420/828] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:22:15 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1793 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:22:17.138574 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:17.139196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:17.145714 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:17.146417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:17.147181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:17.147672 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:17.279845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:17.288484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c13cb26b-8973-48b5-b2c4-6962255b742d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.153581 Jun 03 16:22:17.289331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 409/829] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:17 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:18.305744 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:18.306572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:18.313263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:18.313716 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:18.314493 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:18.314930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:18.452976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:18.460904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-08533fd3-37ec-4a31-8a0d-03da1d3f5136 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.158993 Jun 03 16:22:18.461677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 421/830] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:18 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:19.402011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd20b736-af2b-4485-a3c0-9fe7b081868d"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:19.403844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:19.410026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:19.410464 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:19.411233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:19.411748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:19.479039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:19.479924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:19.486756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:19.487459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:19.488238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:19.488675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:19.623678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:19.631067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-696419bd-f619-4bf2-9bec-6b3881592da6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.157210 Jun 03 16:22:19.631673 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 422/831] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:19 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:20.648736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:20.649361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:20.655883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:20.656341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:20.657120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:20.657559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:20.795820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:20.804150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-017be881-a1a6-4ae0-b503-cfff446d5453 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.159836 Jun 03 16:22:20.804997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 423/832] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:20 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:21.821880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:21.822570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:21.828926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:21.829377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:21.830143 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:21.830583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:22.125514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:22.135375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0ba53efe-9a24-4e1f-8404-a866489e0995 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.317753 Jun 03 16:22:22.136125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 424/833] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:21 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:23.153390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:23.154043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:23.166856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:23.167327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:23.168113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:23.168551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:23.313163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:23.321436 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ca9e589a-ceb7-4c9f-a8ae-badff6c21ac9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.172266 Jun 03 16:22:23.321989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 425/834] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:23 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:24.339225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:24.340140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:24.342366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=4 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:24.347934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:24.348383 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:24.349925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:24.350398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:24.485062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:24.494887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4b99d228-26a5-4b31-a492-111addd88048 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.160149 Jun 03 16:22:24.504742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 426/835] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:24 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:24.848393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:25.010436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=8 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:25.512919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:25.513565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:25.520500 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:25.521218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:25.522004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:25.522448 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:25.651855 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:25.659919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-36d997a9-9910-4c88-83aa-b6946eb3586c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.151084 Jun 03 16:22:25.660722 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 427/836] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:25 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:26.677670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:26.678437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:26.684934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:26.685380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:26.686266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:26.686698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:26.819194 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:26.826487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-288766c9-de81-4aae-80ec-8890d8f0bb4d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.153897 Jun 03 16:22:26.827040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 428/837] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:26 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:27.843832 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:27.844449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:27.850894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:27.851371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:27.852145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:27.852587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:27.975381 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:27.982691 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6daebbc3-c163-44b0-8aa3-a5dcd84759b6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.142826 Jun 03 16:22:27.983243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 429/838] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:27 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:28.999176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:28.999857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:29.002128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:29.007424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:29.007877 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:29.008648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:29.009089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:29.136298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:29.144032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8acaedb9-2990-4538-a3eb-a64f6f58d090 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.148683 Jun 03 16:22:29.144638 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 430/839] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:28 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:29.407278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:29.496542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=63 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:30.161866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:30.162477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:30.170848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:30.171315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:30.172092 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:30.172526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:30.307113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:30.314446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9f25f0e3-8ecb-4949-a556-b191146a2067 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.156411 Jun 03 16:22:30.314992 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 431/840] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:30 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:31.331746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:31.332356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:31.339310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:31.339768 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:31.340530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:31.340964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:31.465248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:31.472781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-aab5726d-cbdd-4381-b75d-1bf80290a580 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.144787 Jun 03 16:22:31.473267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 432/841] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:31 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:31.979220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d2295b9c-d2ba-4f13-bf01-8032636b8fb0 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.766381 Jun 03 16:22:31.979864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 410/842] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:22:19 2022] POST /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments => generated 194 bytes in 12768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:32.491882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:32.493240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:32.516965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:32.518344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:32.520007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:32.520701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:32.569592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-5e0f2669-209e-4dec-b43b-1e38e07415a1 req-615b71c6-c73b-40b5-bd63-2dd545968464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:32.578393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5e0f2669-209e-4dec-b43b-1e38e07415a1 req-615b71c6-c73b-40b5-bd63-2dd545968464 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:32.579222 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5e0f2669-209e-4dec-b43b-1e38e07415a1 req-615b71c6-c73b-40b5-bd63-2dd545968464 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:32.593605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-5e0f2669-209e-4dec-b43b-1e38e07415a1 req-615b71c6-c73b-40b5-bd63-2dd545968464 service nova] Creating event network-changed:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:22:32.598555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-5e0f2669-209e-4dec-b43b-1e38e07415a1 req-615b71c6-c73b-40b5-bd63-2dd545968464 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108048 Jun 03 16:22:32.599412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 411/843] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:32.697369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:32.707598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a6015612-6e63-4af3-87ad-1ae16a668fb0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.221155 Jun 03 16:22:32.708250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 433/844] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:32 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:33.725012 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:33.726199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:33.732426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:33.732877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:33.733644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:33.734095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:33.860645 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:33.868673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-416925fc-6cc5-48b0-af23-0ae7f08830a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.148279 Jun 03 16:22:33.869239 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 412/845] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:33 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:34.886146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:34.886756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:34.893007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:34.893447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:34.894206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:34.894644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:35.024373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:35.031752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-84b0ddc8-1ccf-4e2f-ba1d-052fc72a0aba tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.150080 Jun 03 16:22:35.032293 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 434/846] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:34 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:36.048002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:36.048620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:36.055229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:36.055699 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:36.056491 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:36.056933 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:36.189953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:36.198292 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9e8c90b2-a0d3-4345-b144-50b9e3fb11b0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.154161 Jun 03 16:22:36.207556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 413/847] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:36 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:37.217578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:37.218557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:37.229894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:37.230590 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:37.231821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:37.232490 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:37.376273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:37.378435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:37.385429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bc282c16-0c4b-42aa-bbfd-d7b822e0721f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.173374 Jun 03 16:22:37.385986 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 435/848] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:37 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:38.402496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:38.403128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:38.409559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:38.410011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:38.410779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:38.411215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:38.545553 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:38.546842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-22d6d486-cc65-4bd4-8c5a-fc53f1b9d5f3 req-c91b3add-664d-4cb5-acb3-efe3376ac25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "name": "network-vif-plugged", "status": "completed", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:38.553319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3bfb72dc-bf24-4e2e-ba7b-21410df13787 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.154666 Jun 03 16:22:38.553898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 414/849] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:38 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:38.557079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-22d6d486-cc65-4bd4-8c5a-fc53f1b9d5f3 req-c91b3add-664d-4cb5-acb3-efe3376ac25d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:38.557562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-22d6d486-cc65-4bd4-8c5a-fc53f1b9d5f3 req-c91b3add-664d-4cb5-acb3-efe3376ac25d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:38.569843 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-22d6d486-cc65-4bd4-8c5a-fc53f1b9d5f3 req-c91b3add-664d-4cb5-acb3-efe3376ac25d service nova] Creating event network-vif-plugged:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:22:38.574831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-22d6d486-cc65-4bd4-8c5a-fc53f1b9d5f3 req-c91b3add-664d-4cb5-acb3-efe3376ac25d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032504 Jun 03 16:22:38.575428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 436/850] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:22:39.469953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:39.471012 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:39.477386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:39.477771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:39.478564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:39.478999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:39.501172 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lazy-loading 'flavor' on Instance uuid 58b7d211-5b5b-4d26-aa96-cb295c20451d {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:22:39.570966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:39.571687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:39.578251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:39.579042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:39.580070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:39.580749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:39.624159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3977b724-ae8a-475a-b480-fab0cb28a83c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/action" status: 200 len: 32 microversion: 2.1 time: 0.158039 Jun 03 16:22:39.624867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 415/851] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:22:39 2022] POST /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:22:39.635145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:39.635901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:39.642456 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:39.642889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:39.643842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:39.644425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:39.716948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:39.724429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9c3b2d11-a4b3-4e0d-9d40-282041996f20 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.158119 Jun 03 16:22:39.725585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 437/852] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:39 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:39.779362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:39.787276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-65f0ad80-3741-484b-aa86-8bcceddb3554 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.156842 Jun 03 16:22:39.787870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 416/853] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:39 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:40.741842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:40.743325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:40.751011 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:40.751583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:40.752447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:40.752970 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:40.805039 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:40.805759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:40.812275 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:40.812736 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:40.813618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:40.814143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:40.903333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:40.910866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ce684677-a517-4de3-8002-8dc898683149 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1357 microversion: 2.1 time: 0.172941 Jun 03 16:22:40.911449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 438/854] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:40 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:40.947470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:40.955400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ec9baf96-cb03-45df-93af-643e5a93517b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.154762 Jun 03 16:22:40.955965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 417/855] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:40 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:41.927657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:41.928269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:41.935353 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:41.935805 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:41.936659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:41.937100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:41.972445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:41.973065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:41.980095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:41.980751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:41.981732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:41.982168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.064169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:42.072002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4c5e526e-f070-454e-92a0-7ec056e18d21 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1547 microversion: 2.1 time: 0.148115 Jun 03 16:22:42.073413 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 439/856] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:41 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:42.088177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:42.088800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:42.094979 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:42.095463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.096248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:42.096700 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.112758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:42.120911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b16bf4eb-3ca8-4d22-9828-f8d434cdcf16 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.152252 Jun 03 16:22:42.121484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 418/857] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:41 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:42.224727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:42.232226 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a175bcfa-d700-4538-b32d-89f9076bf055 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1547 microversion: 2.1 time: 0.147812 Jun 03 16:22:42.232778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 440/858] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:42 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:42.247683 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:42.251103 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:42.251890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Searching by: {'deleted': False, 'project_id': '566b367dc7504d3091558cfd6f35bfa9'} {{(pid=117570) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 16:22:42.259077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:42.259561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.260348 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:42.260786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.348097 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.multi_cell_list [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117570) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 16:22:42.441033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d39a83b2-51ab-4a50-aff0-49691ae1c316 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196995 Jun 03 16:22:42.441713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 419/859] 10.222.0.41 () {58 vars in 1124 bytes} [Fri Jun 3 16:22:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:42.451994 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:42.452641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:42.458623 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:42.459082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.460455 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:42.460902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:42.583938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:42.591960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1663d13e-d748-4f7e-8094-91f3eccfc8d1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1547 microversion: 2.1 time: 0.143836 Jun 03 16:22:42.592519 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 441/860] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:42 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:43.138171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:43.138790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:43.145496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:43.145949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:43.146717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:43.147159 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:43.282446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:43.291001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f389d52c-45c8-48ba-b878-b5fa68895274 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.156789 Jun 03 16:22:43.291620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 420/861] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:43 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:44.089230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "249e2bc4-80fc-4398-ba42-da71ce29746f"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:44.090330 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:44.097570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:44.098023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:44.098803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:44.099239 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:44.308709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:44.309445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:44.316193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:44.316639 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:44.317408 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:44.317873 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:44.338612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ab9952b1-08da-475d-a935-27811e895df0 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253650 Jun 03 16:22:44.339390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 442/862] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:22:44 2022] POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:44.461862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:44.469902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b7ee820a-e9cc-4437-9003-9da255026994 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.165678 Jun 03 16:22:44.470477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 421/863] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:44 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:45.488460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:45.489096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:45.495808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:45.496260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:45.497028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:45.497470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:45.624061 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:45.632560 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c681ec08-e87d-415f-8f71-c8e7956d0084 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.148397 Jun 03 16:22:45.633119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 443/864] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:45 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:46.650141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:46.650787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:46.657455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:46.657908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:46.658676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:46.659111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:46.786870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:46.794650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-29abc55a-bf22-4082-bb1b-806c91c590a2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.149147 Jun 03 16:22:46.795209 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 422/865] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:46 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:47.812236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:47.812766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:47.820057 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:47.820517 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:47.821302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:47.821752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:47.947251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:47.955242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e8eb0a9d-35c0-442c-82e2-10e4e5bf0d8f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.147032 Jun 03 16:22:47.955825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 444/866] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:47 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:48.972023 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:48.972579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:48.979064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:48.979541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:48.980300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:48.980735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:49.105466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:49.113299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4efafd10-5168-436b-b904-bac9fcdcde5b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.145133 Jun 03 16:22:49.113867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 423/867] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:48 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:49.679785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:49.680320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:49.686686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:49.687136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:49.687956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:49.688396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:49.765409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lazy-loading 'services' on Instance uuid 2de1f638-4fee-41e2-bd50-b802f8494fad {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:22:49.835695 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-90125a96-eb0f-4004-a204-b1e295d04cde tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-volume_attachments/c9602843-9199-4436-a162-bbd89e478f8a" status: 202 len: 0 microversion: 2.1 time: 0.160408 Jun 03 16:22:49.836472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 445/868] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:22:49 2022] DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-volume_attachments/c9602843-9199-4436-a162-bbd89e478f8a => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:22:50.129970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:50.130542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:50.137611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:50.138063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:50.138833 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:50.139271 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:50.157547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:50.271617 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:50.279602 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3c6a2cef-a17c-418a-a1fe-c80cf8a3b519 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.153620 Jun 03 16:22:50.280158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 424/869] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:50 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:51.297672 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:51.298366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:51.306089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:51.306540 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:51.307323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:51.307765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:51.436548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:51.445076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3eb22415-8d3d-4c2d-85db-ff0b9b87af94 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.151594 Jun 03 16:22:51.445632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 446/870] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:51 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:51.872397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:51.873007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:51.879786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:51.880249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:51.881055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:51.881991 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:52.016298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:52.024889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bcc2d46f-fc00-4b3a-ba57-5621957ffadd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1593 microversion: 2.1 time: 0.157240 Jun 03 16:22:52.025454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 425/871] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:51 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:52.462171 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:52.462822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:52.469315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:52.469782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:52.470571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:52.471015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:52.603499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:52.612443 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b80a29c7-b78d-4ac5-8e56-9156c9caebbb tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.154725 Jun 03 16:22:52.619484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 447/872] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:52 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:53.048744 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-09f8ed8f-a73c-4e44-8c0c-69fec3e339ca tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:53.050575 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:53.056730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-09f8ed8f-a73c-4e44-8c0c-69fec3e339ca tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:53.057185 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-09f8ed8f-a73c-4e44-8c0c-69fec3e339ca tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:53.079274 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-09f8ed8f-a73c-4e44-8c0c-69fec3e339ca tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Going to try to stop instance {{(pid=117570) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 16:22:53.119973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-09f8ed8f-a73c-4e44-8c0c-69fec3e339ca tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action" status: 202 len: 0 microversion: 2.1 time: 0.074859 Jun 03 16:22:53.123730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 426/873] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:22:53 2022] POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:22:53.130050 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:53.130714 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:53.138879 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:53.139853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:53.140631 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:53.141226 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:53.279352 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:53.286904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-63f793b5-eae0-47a3-890a-15021847a3c6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.161917 Jun 03 16:22:53.288065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 448/874] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:53 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:53.630530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:53.631220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:53.637801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:53.638248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:53.639022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:53.639491 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:53.746659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-31f87f53-9ee2-4a0c-81e9-c5e6eebc678c req-5b00e216-4fb3-455d-ba8b-2c711b87bae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:53.760120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-31f87f53-9ee2-4a0c-81e9-c5e6eebc678c req-5b00e216-4fb3-455d-ba8b-2c711b87bae7 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:53.760806 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-31f87f53-9ee2-4a0c-81e9-c5e6eebc678c req-5b00e216-4fb3-455d-ba8b-2c711b87bae7 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:53.774698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-31f87f53-9ee2-4a0c-81e9-c5e6eebc678c req-5b00e216-4fb3-455d-ba8b-2c711b87bae7 service nova] Creating event network-changed:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:22:53.780661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-31f87f53-9ee2-4a0c-81e9-c5e6eebc678c req-5b00e216-4fb3-455d-ba8b-2c711b87bae7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039359 Jun 03 16:22:53.781891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 449/875] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:53.822431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:53.832758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-23a40a30-1b6b-4a31-8e7c-421382044406 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.206440 Jun 03 16:22:53.843476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 427/876] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:53 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:54.304915 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:54.305766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:54.312344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:54.313015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:54.313944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:54.314499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:54.597115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:54.607338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-de47ac98-6b17-4469-84b4-283623407b7b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.307036 Jun 03 16:22:54.607997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 450/877] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:54 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:54.851010 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:54.852139 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:54.859441 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:54.860000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:54.860870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:54.861386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.030541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:55.040315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f1aabb66-4877-4338-95b2-e559c9605664 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.193736 Jun 03 16:22:55.040884 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 428/878] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:54 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:55.071812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2035926710"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:55.072349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:55.078740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.079193 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.080024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.080460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.204929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.network.security_group_api [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Adding security group 851f2bb5-1c5b-4e83-a416-39aca1f3186f to port 25a621ae-2091-4b52-92c0-c980de0c7607 Jun 03 16:22:55.625063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:55.625706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:55.632165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.632608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.633366 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.633807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.765767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:55.773650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2e361d69-17ad-4c7d-bf21-44e363859a8a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.152305 Jun 03 16:22:55.774254 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 429/879] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:55 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:55.824267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d85249dd-7316-4723-b6f3-70aa471392a9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/action" status: 202 len: 0 microversion: 2.1 time: 0.756307 Jun 03 16:22:55.825711 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 451/880] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:22:55 2022] POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:22:55.836592 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-a2712720-81cb-470f-aff4-d42dae92f229 req-7862a580-1f28-4b16-ab60-67d7f6f7d5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:22:55.845330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:55.846236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:55.853929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-a2712720-81cb-470f-aff4-d42dae92f229 req-7862a580-1f28-4b16-ab60-67d7f6f7d5b8 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.854382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-a2712720-81cb-470f-aff4-d42dae92f229 req-7862a580-1f28-4b16-ab60-67d7f6f7d5b8 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.861513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.862048 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.862737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:55.863175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:55.877608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:55.890990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-a2712720-81cb-470f-aff4-d42dae92f229 req-7862a580-1f28-4b16-ab60-67d7f6f7d5b8 service nova] Creating event network-changed:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:22:55.897302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-a2712720-81cb-470f-aff4-d42dae92f229 req-7862a580-1f28-4b16-ab60-67d7f6f7d5b8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066540 Jun 03 16:22:55.901198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 452/881] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:22:56.053835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:56.059581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:56.060336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:56.063118 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-41fdede8-6b1d-4825-9f03-cbfb0f1fbbce tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1759 microversion: 2.1 time: 0.233278 Jun 03 16:22:56.064435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 430/882] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:55 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:56.071564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:56.072265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:56.073658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:56.074250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:56.287990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:56.296668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b0bc2294-60b7-4dfe-a0b9-0875561ccbd6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.242121 Jun 03 16:22:56.297308 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 453/883] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:56 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:22:56.791515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:56.792133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:56.798198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:56.798651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:56.799445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:56.799883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:57.152895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:57.160306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c4207619-bfa8-40d4-8c43-4c24c2c9bbd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.373248 Jun 03 16:22:57.160867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 431/884] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:56 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:57.314764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:57.315418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:57.321881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:57.322326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:57.323096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:57.323567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:57.448665 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:57.456604 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d782919c-bde7-4634-a93a-0e9ca93ad09f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.145669 Jun 03 16:22:57.457168 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 454/885] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:57 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:58.178238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:58.178838 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:58.185217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:58.185664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:58.186420 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:58.186852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:58.319235 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:58.326941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-179a3dd7-0d2d-4b46-8066-9ddc4cf85512 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.152982 Jun 03 16:22:58.327537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 432/886] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:58 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:58.473989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:58.474526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:58.481535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:58.481995 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:58.482766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:58.483208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:58.610865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:58.619488 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cd2f0ce1-4fad-48ad-b1f1-5c2d68af5218 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.149448 Jun 03 16:22:58.620040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 455/887] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:58 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:59.344441 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:59.345050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:59.352360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:59.352809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:59.353570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:59.354000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:59.481812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:59.489137 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ba1542e8-e0ca-41e1-a1ca-eb393072985e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.148880 Jun 03 16:22:59.489704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 433/888] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:59 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:22:59.636848 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:22:59.637471 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:22:59.639880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=52 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:22:59.645298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:59.645756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:59.646537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:22:59.646981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:22:59.808726 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:22:59.816740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-50d17df7-46b2-4128-a4ef-dc877239f851 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.184377 Jun 03 16:22:59.817308 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 456/889] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:22:59 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:00.506079 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:00.506617 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:00.508998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=47 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:00.514535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:00.514984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:00.515764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:00.516201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:00.641143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:00.649518 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bb51e55f-d5f6-4733-9926-67928a83f2d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.147345 Jun 03 16:23:00.650085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 434/890] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:00 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:00.835092 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:00.835761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:00.842248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:00.842705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:00.843524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:00.843971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:00.974133 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:00.982643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5666a0b3-9073-4679-9d1e-9c40ab74e57d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.152032 Jun 03 16:23:00.983201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 457/891] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:00 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:01.666461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:01.667080 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:01.673578 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:01.674071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:01.674861 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:01.675323 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:01.803138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:01.811372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bf4e6673-98d7-4301-83b1-e8ae4b7e1ba6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.148812 Jun 03 16:23:01.811938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 435/892] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:01 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:02.000604 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:02.015028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:02.015028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:02.015028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:02.015028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:02.015472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:02.137589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:02.145971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-29264f61-fee8-473b-8fc3-2e1b67ecb8b2 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1736 microversion: 2.1 time: 0.149376 Jun 03 16:23:02.146579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 458/893] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:01 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:02.829309 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:02.829942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:02.836849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:02.837301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:02.838068 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:02.838507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:02.965196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:02.972661 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b181796a-c3f8-4f98-9f46-d3b84901f5ee tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.147202 Jun 03 16:23:02.973246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 436/894] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:02 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:03.163231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:03.163876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:03.170397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.170850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.171662 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.172107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.304857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:03.312880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dee95ceb-2094-41e8-85ee-025c28d1830d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1716 microversion: 2.1 time: 0.153708 Jun 03 16:23:03.313424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 459/895] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:03 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:03.368256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:03.368763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:03.375027 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.375554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.376340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.376787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.457167 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] HTTP exception thrown: Cannot 'detach_volume' instance 58b7d211-5b5b-4d26-aa96-cb295c20451d while it is in vm_state rescued Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Request method failure captured: Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments/fd20b736-af2b-4485-a3c0-9fe7b081868d HTTP/1.1 Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO8CvWPyoGUGP7589mDfybb0r4x4SIfyl7oWrTkzfwNMVxJ7YY4L7okSJ02orQcqE8viW_VKf4NFF1cBpsNksHfWkEQkayTtL_IkXahuioGHODuDL3RAH7U6m7Q3fq_LgXhmBUPe5Yfc6LwvahIygeKT0ma-hZUV8Mpyy_dVOHpRiA Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:23:03.458757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1443b802dc724950b5eb5c6446e2515c"}]}] Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 4206a21c317e4b5aace8541699f8032d Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:23:03.460340 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Cannot 'detach_volume' instance 58b7d211-5b5b-4d26-aa96-cb295c20451d while it is in vm_state rescued Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'server_id': '58b7d211-5b5b-4d26-aa96-cb295c20451d', 'id': 'fd20b736-af2b-4485-a3c0-9fe7b081868d'} Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:23:03.461134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 58b7d211-5b5b-4d26-aa96-cb295c20451d while it is in vm_state rescued Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 58b7d211-5b5b-4d26-aa96-cb295c20451d while it is in vm_state rescued Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:03.462629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Returning 409 to user: Cannot 'detach_volume' instance 58b7d211-5b5b-4d26-aa96-cb295c20451d while it is in vm_state rescued {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:23:03.463910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-634b9716-3132-44ec-8d18-0dccca8b55d3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments/fd20b736-af2b-4485-a3c0-9fe7b081868d" status: 409 len: 152 microversion: 2.1 time: 0.096487 Jun 03 16:23:03.463910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 437/896] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:23:03 2022] DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments/fd20b736-af2b-4485-a3c0-9fe7b081868d => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 16:23:03.469049 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:03.469588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:03.475535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.475990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.476754 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.477194 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.541228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3b82944d-6776-4d79-ab13-d0d2861537ed tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "POST /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/action" status: 202 len: 0 microversion: 2.1 time: 0.075774 Jun 03 16:23:03.544877 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 460/897] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:23:03 2022] POST /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:23:03.549876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:03.550499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:03.557785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.558437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.559412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.559976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.696137 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:03.704524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-dce491c8-6622-4696-a44a-41ed9bcf4d65 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1724 microversion: 2.1 time: 0.158252 Jun 03 16:23:03.705285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 438/898] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:03 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:03.990487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:03.991698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:03.997909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.998367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:03.999154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:03.999630 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:04.181058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:04.188836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f04c099d-0b66-40fc-857e-9f9a566f0bd4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.202718 Jun 03 16:23:04.189469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 461/899] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:03 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:04.722199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:04.722812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:04.729360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:04.729810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:04.730572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:04.731011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:04.862777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:04.871597 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-42369a9d-e5ef-41b3-83fe-5d0f26839035 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1724 microversion: 2.1 time: 0.153207 Jun 03 16:23:04.872158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 439/900] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:04 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:05.205921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:05.206577 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:05.213070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:05.213525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:05.214298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:05.214740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:05.341709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:05.349116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-07210ac3-5e55-4cda-8ffc-79f3f9d93e7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.147050 Jun 03 16:23:05.349666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 462/901] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:05 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:05.889347 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:05.889956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:05.896640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:05.897693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:05.898449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:05.898881 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:05.902816 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:06.024922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:06.032674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-99a051ff-12d0-4511-9060-3afac00fe93c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1724 microversion: 2.1 time: 0.147220 Jun 03 16:23:06.033236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 440/902] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:05 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:06.366980 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:06.367612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:06.374279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:06.374730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:06.375526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:06.375961 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:06.503257 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:06.510923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8f8490a7-1a90-49a3-a2ca-8ca2673aed92 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.148279 Jun 03 16:23:06.511516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 463/903] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:06 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:07.049832 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:07.050452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:07.057677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.058130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.058902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.059437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.196603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:07.204646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9418c2f1-7918-4994-953d-fee70bc15ad4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1724 microversion: 2.1 time: 0.158634 Jun 03 16:23:07.205219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 441/904] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:07 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:07.528074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:07.528776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:07.535271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.535748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.536515 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.536950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.693749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:07.701145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fe958c78-9199-4629-9955-eb4705d0acbb tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.176941 Jun 03 16:23:07.701701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 464/905] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:07 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:07.845387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:07.845879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:07.852352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.852801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.853556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.853993 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.877463 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:23:07.948149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-122b4d10-64b1-4f8c-9379-9ef8b29351cd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 204 len: 0 microversion: 2.1 time: 0.106285 Jun 03 16:23:07.948626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 442/906] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:23:07 2022] DELETE /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:23:07.956593 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:07.957191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:07.963609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.964058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:07.964822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:07.965260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:08.094544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:08.102910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-33f8b00c-f22c-4292-a1f3-0624a46401f0 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1576 microversion: 2.1 time: 0.150200 Jun 03 16:23:08.103503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 465/907] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:07 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:08.222476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:08.223091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:08.230002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:08.230448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:08.231214 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:08.231670 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:08.361274 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:08.369712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d6d0c653-4f4d-4706-8a3a-6d23bfc4666a tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1724 microversion: 2.1 time: 0.151514 Jun 03 16:23:08.370308 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 443/908] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:08 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:08.718107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:08.718745 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:08.725603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:08.726060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:08.726854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:08.727313 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:08.854857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:08.862296 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a759c917-32aa-4de4-952d-21a81196d3d9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.148237 Jun 03 16:23:08.862856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 466/909] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:08 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:09.120880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:09.121508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:09.127425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.127874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.128629 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.129061 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.260131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:09.267632 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c7507b90-8bf1-47f6-9589-2f6db089978e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1576 microversion: 2.1 time: 0.150572 Jun 03 16:23:09.268188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 444/910] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:09 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:09.387332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:09.387948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:09.393837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.394287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.395331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.395772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.521559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:09.529926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7daa78b9-a4c7-4e60-ac04-5a4cb8232bb6 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1730 microversion: 2.1 time: 0.146431 Jun 03 16:23:09.530481 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 467/911] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:09 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:09.546845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:09.547375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:09.553434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.553887 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.554661 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.555132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.629448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1f4a5895-b42f-4aba-a72c-347fd46f631c tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086466 Jun 03 16:23:09.630042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 445/912] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:23:09 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:09.879990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:09.880613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:09.887611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.888072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.888867 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:09.889315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:09.905258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:10.023143 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:10.030599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cb02c4fd-b9d6-4dad-baa9-eacf020447f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1677 microversion: 2.1 time: 0.154481 Jun 03 16:23:10.031172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 468/913] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:09 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:10.285688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:10.286301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:10.292400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:10.292840 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:10.293811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:10.294240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:10.520949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:10.531020 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-38169963-7ad8-4d2f-9485-c97ce2e184f6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1576 microversion: 2.1 time: 0.249662 Jun 03 16:23:10.541261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 446/914] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:10 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:10.586269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-ca06d33e-7733-48c6-b5c3-eecfa8f292c1 req-2e538902-ff09-45be-9b5c-d81e4dbfffa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b7d211-5b5b-4d26-aa96-cb295c20451d", "tag": "00ec2058-4aa7-4f71-a6fa-0278283989c0"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:10.597657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-ca06d33e-7733-48c6-b5c3-eecfa8f292c1 req-2e538902-ff09-45be-9b5c-d81e4dbfffa3 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:10.598111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-ca06d33e-7733-48c6-b5c3-eecfa8f292c1 req-2e538902-ff09-45be-9b5c-d81e4dbfffa3 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:10.609068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-ca06d33e-7733-48c6-b5c3-eecfa8f292c1 req-2e538902-ff09-45be-9b5c-d81e4dbfffa3 service nova] Creating event network-changed:00ec2058-4aa7-4f71-a6fa-0278283989c0 for instance 58b7d211-5b5b-4d26-aa96-cb295c20451d on hv-cinder-83699 Jun 03 16:23:10.613849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-ca06d33e-7733-48c6-b5c3-eecfa8f292c1 req-2e538902-ff09-45be-9b5c-d81e4dbfffa3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Jun 03 16:23:10.614426 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 469/915] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:11.047894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:11.048516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:11.055021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.055742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.056520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.057146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.188101 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:11.195563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ed928500-2228-4c84-9263-453321a618ef tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1654 microversion: 2.1 time: 0.152366 Jun 03 16:23:11.196134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 447/916] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:11 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:11.212869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cd2e8e2b-e090-4112-a33c-7e2e30a15d4e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:11.219740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd2e8e2b-e090-4112-a33c-7e2e30a15d4e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.220378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cd2e8e2b-e090-4112-a33c-7e2e30a15d4e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.262493 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cd2e8e2b-e090-4112-a33c-7e2e30a15d4e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Going to try to start instance {{(pid=117571) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 16:23:11.311718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cd2e8e2b-e090-4112-a33c-7e2e30a15d4e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action" status: 202 len: 0 microversion: 2.1 time: 0.103196 Jun 03 16:23:11.312341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 470/917] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:23:11 2022] POST /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:23:11.320511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:11.321181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:11.328123 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.328675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.329671 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.330248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.496043 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:11.503516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f62b91cd-4c34-4200-8069-9a6342c999f6 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1663 microversion: 2.1 time: 0.186862 Jun 03 16:23:11.504083 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 448/918] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:11 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1663 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:11.547536 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:11.548244 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:11.554415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.554863 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.555660 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:11.556105 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:11.683729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:11.691747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ec7539fe-ddad-4828-a5af-9c9dd0c1e068 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1576 microversion: 2.1 time: 0.148317 Jun 03 16:23:11.699851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 471/919] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:11 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:12.522275 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:12.522844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:12.529810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:12.530259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:12.531039 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:12.531518 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:12.637386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-f83f4f86-a681-4470-9383-9094f77a11d7 req-0ca4e167-3bac-4a1c-a9d6-ca109086de62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b7d211-5b5b-4d26-aa96-cb295c20451d", "tag": "00ec2058-4aa7-4f71-a6fa-0278283989c0"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:12.646204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-f83f4f86-a681-4470-9383-9094f77a11d7 req-0ca4e167-3bac-4a1c-a9d6-ca109086de62 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:12.646658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-f83f4f86-a681-4470-9383-9094f77a11d7 req-0ca4e167-3bac-4a1c-a9d6-ca109086de62 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:12.658827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-f83f4f86-a681-4470-9383-9094f77a11d7 req-0ca4e167-3bac-4a1c-a9d6-ca109086de62 service nova] Creating event network-changed:00ec2058-4aa7-4f71-a6fa-0278283989c0 for instance 58b7d211-5b5b-4d26-aa96-cb295c20451d on hv-cinder-83699 Jun 03 16:23:12.663903 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-f83f4f86-a681-4470-9383-9094f77a11d7 req-0ca4e167-3bac-4a1c-a9d6-ca109086de62 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030092 Jun 03 16:23:12.664790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 472/920] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:23:12.712119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:12.713543 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:12.720872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:12.721689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:12.722252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:12.722754 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:12.889298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:12.899245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5cde758e-6615-4bef-9b30-306826718ab0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1663 microversion: 2.1 time: 0.381612 Jun 03 16:23:12.911128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 449/921] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:12 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1663 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:12.969073 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:12.979605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e48173ad-df5f-4863-8ddc-414b21cf5e26 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1576 microversion: 2.1 time: 0.273473 Jun 03 16:23:12.980679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 473/922] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:12 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:13.917770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:13.918636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:13.925495 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:13.926034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:13.926910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:13.927470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:14.005789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:14.006558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:14.023885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:14.024496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:14.025362 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:14.025962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:14.092265 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:14.092994 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:14.093656 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lazy-loading 'fault' on Instance uuid 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:23:14.138722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:14.148468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:14.149652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-828665cb-5e0d-4a8b-a0bf-4aa5d94614e9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1667 microversion: 2.1 time: 0.235665 Jun 03 16:23:14.156769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 450/923] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:13 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1667 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:14.164156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-370043df-9d1d-48c2-bad1-5785498ee788 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 200 len: 1229 microversion: 2.1 time: 0.171694 Jun 03 16:23:14.165213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 474/924] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:13 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 1229 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:14.681944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-6e3ee946-fc7a-487c-9a41-1759ed509e70 req-20e9bc1b-d659-476c-a758-389471fa2544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea2cd56-026c-4b2e-a39a-35bc5db65f46", "name": "network-vif-deleted", "tag": "373d5130-e651-4986-b65f-2e89d25c7140"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:14.690220 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-6e3ee946-fc7a-487c-9a41-1759ed509e70 req-20e9bc1b-d659-476c-a758-389471fa2544 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:14.690660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-6e3ee946-fc7a-487c-9a41-1759ed509e70 req-20e9bc1b-d659-476c-a758-389471fa2544 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:14.702609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-6e3ee946-fc7a-487c-9a41-1759ed509e70 req-20e9bc1b-d659-476c-a758-389471fa2544 service nova] Creating event network-vif-deleted:373d5130-e651-4986-b65f-2e89d25c7140 for instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 on hv-cinder-83699 Jun 03 16:23:14.707660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-6e3ee946-fc7a-487c-9a41-1759ed509e70 req-20e9bc1b-d659-476c-a758-389471fa2544 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Jun 03 16:23:14.708435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 451/925] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:15.181400 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:15.182137 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:15.188698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:15.189153 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:15.189929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:15.190402 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:15.203943 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] HTTP exception thrown: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Request method failure captured: Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 HTTP/1.1 Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjRShUfHIjbndzvv9_4tpszxRzIg6BVt0HriYVhkAKwmKIhNIlEgSgecw4b-qPNqHevfcYhZ6ygRw7N2wBXMl61tpxn0JxnoiUZfk_gVMEqyJRymNhgJFlN2MBZEx77-6qWs8K25B_-SGKgRRW7Fv_yzQ7BhXfvDUayb-zzwwzutFgk Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:23:15.205607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7d586c0c8dd34398af9d52425eb2bde3"}]}] Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 331c97a12f1b4c2eb1eefa61056ce089 Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:23:15.207589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '7ea2cd56-026c-4b2e-a39a-35bc5db65f46'} Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:23:15.208475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:23:15.209909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:15.211195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Returning 404 to user: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:23:15.211195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-48877018-b869-480c-bf2b-7942549fab27 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 404 len: 111 microversion: 2.1 time: 0.030119 Jun 03 16:23:15.211195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 475/926] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:15 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:23:15.306095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-280877949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-540010629", "security_groups": [{"name": "tempest-secgroup-smoke-604653336"}], "block_device_mapping_v2": [{"uuid": "729e135d-74cb-41f9-912d-fe4558733be0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6170e7ad-2948-49aa-8d76-bb5733efca78"}]}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:15.424247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] validate_networks() for [('6170e7ad-2948-49aa-8d76-bb5733efca78', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:23:15.799583 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:23:15.800087 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:23:15.800647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:23:15.801068 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:23:15.801486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:23:15.811018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:15.811507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:15.812319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:15.812762 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:15.829686 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:23:15.833659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for user 331c97a12f1b4c2eb1eefa61056ce089 and project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:23:15.889459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:23:15.891688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='729e135d-74cb-41f9-912d-fe4558733be0',volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:23:16.015694 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-413ff7ce-24c2-4d0c-8bf4-63ac80568b83 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713827 Jun 03 16:23:16.016345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 452/927] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:23:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:23:16.026989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2610b5b0-562d-427a-8657-c3b489ff00bf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:16.027643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2610b5b0-562d-427a-8657-c3b489ff00bf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:16.079725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2610b5b0-562d-427a-8657-c3b489ff00bf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:16.087174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2610b5b0-562d-427a-8657-c3b489ff00bf tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1093 microversion: 2.1 time: 0.063888 Jun 03 16:23:16.087671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 476/928] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:16 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:17.105131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:17.106346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:17.113970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:17.114696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:17.115790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:17.116447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:17.181719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:17.189727 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-88659f71-5116-4551-a33d-e3c3ab6da19c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1209 microversion: 2.1 time: 0.089547 Jun 03 16:23:17.190437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 453/929] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:17 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:18.207054 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:18.207858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:18.215923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:18.216799 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:18.217782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:18.218231 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:18.430391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-755eec87-c314-407f-b559-9fa655d4851f req-f348ba04-4574-4188-97fd-25f36f7998e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0", "tag": "e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:18.436807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:18.443166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-755eec87-c314-407f-b559-9fa655d4851f req-f348ba04-4574-4188-97fd-25f36f7998e1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:18.444397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-755eec87-c314-407f-b559-9fa655d4851f req-f348ba04-4574-4188-97fd-25f36f7998e1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:18.449253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cdecbc86-c48d-41d5-9023-124f91d21a85 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.246067 Jun 03 16:23:18.456163 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-755eec87-c314-407f-b559-9fa655d4851f req-f348ba04-4574-4188-97fd-25f36f7998e1 service nova] Creating event network-changed:e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1 for instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 on hv-cinder-83699 Jun 03 16:23:18.456997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 477/930] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:18 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:18.466414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-755eec87-c314-407f-b559-9fa655d4851f req-f348ba04-4574-4188-97fd-25f36f7998e1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040167 Jun 03 16:23:18.467017 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 454/931] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:23:19.466250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:19.466954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:19.474073 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:19.474532 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:19.475366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:19.475819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:19.605114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:19.612749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ccc653d0-7cf2-4e56-8428-213c4afc4a11 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.150452 Jun 03 16:23:19.613310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 478/932] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:19 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:20.630384 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:20.631707 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:20.638303 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:20.638469 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:20.639092 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:20.639594 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:20.772752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:20.780590 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bf764150-24a2-475d-a7d4-38cbded70ce7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.154806 Jun 03 16:23:20.781178 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 455/933] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:20 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:21.796660 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:21.797269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:21.803803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:21.804254 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:21.805049 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:21.805487 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:21.934415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:21.941858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6b68f866-0c44-4383-8f52-cf483d78d12e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.149048 Jun 03 16:23:21.942418 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 479/934] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:21 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:22.176291 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:22.176856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:22.183688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.184142 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.184898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.185360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.207948 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-37547458-b811-439c-a7b5-993388daaaf6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.035554 Jun 03 16:23:22.208500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 456/935] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:23:22 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:22.218774 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d52750c5-c512-46e8-b422-4f637bf18d22"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:22.219879 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:22.225865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.226318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.227088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.227552 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.305158 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Invalid volume: volume d52750c5-c512-46e8-b422-4f637bf18d22 is already attached to instances: aab42cfc-29a0-4c3f-b30b-e5902d661dd2 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: POST /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/os-volume_attachments HTTP/1.1 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 74 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:23:22.306956 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {"volumeAttachment": {"volumeId": "d52750c5-c512-46e8-b422-4f637bf18d22"}} Jun 03 16:23:22.308548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Invalid volume: volume d52750c5-c512-46e8-b422-4f637bf18d22 is already attached to instances: aab42cfc-29a0-4c3f-b30b-e5902d661dd2 Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'server_id': '962bba3e-675b-481f-840a-f5d0d2540cb5', 'body': {'volumeAttachment': {'volumeId': 'd52750c5-c512-46e8-b422-4f637bf18d22'}}} Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d52750c5-c512-46e8-b422-4f637bf18d22 is already attached to instances: aab42cfc-29a0-4c3f-b30b-e5902d661dd2 Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:22.309369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d52750c5-c512-46e8-b422-4f637bf18d22 is already attached to instances: aab42cfc-29a0-4c3f-b30b-e5902d661dd2 Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:22.310554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d52750c5-c512-46e8-b422-4f637bf18d22 is already attached to instances: aab42cfc-29a0-4c3f-b30b-e5902d661dd2 Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 400 to user: Invalid volume: volume d52750c5-c512-46e8-b422-4f637bf18d22 is already attached to instances: aab42cfc-29a0-4c3f-b30b-e5902d661dd2 {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1bf3a5ad-3419-44f8-8d70-8e1e5b6f0d3a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093752 Jun 03 16:23:22.311801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 480/936] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:23:22 2022] POST /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 16:23:22.317272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:22.317755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:22.324751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.325301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.326325 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.326767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.351125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:23:22.353899 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:22.429518 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6bf10c83-1950-4da1-b06f-f2433d15a75a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 204 len: 0 microversion: 2.1 time: 0.115670 Jun 03 16:23:22.431096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 457/937] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:23:22 2022] DELETE /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:23:22.439215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:22.439904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:22.448085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.448531 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.449314 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.449750 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.579925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:22.588053 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bb105f35-615a-4dff-b1d0-d93d283962ac tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1680 microversion: 2.1 time: 0.152759 Jun 03 16:23:22.588614 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 481/938] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:22 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:22.959854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:22.960554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:22.966525 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.966977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:22.967798 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:22.968243 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:23.101389 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:23.108977 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9adbf0fe-f204-45e2-8042-1f0746ecd53f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.153858 Jun 03 16:23:23.109552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 458/939] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:22 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:23.605881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:23.606441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:23.613056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:23.613512 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:23.614283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:23.614730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:23.741627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:23.749093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6c3a7157-693a-43fb-a6d9-6a0fd57fbfab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1680 microversion: 2.1 time: 0.147187 Jun 03 16:23:23.749654 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 482/940] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:23 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:24.125596 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:24.126196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:24.132723 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:24.133171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:24.133943 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:24.134375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:24.267196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:24.275341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bbb37856-7888-42d8-900f-ff06d9f23e79 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.153593 Jun 03 16:23:24.275888 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 459/941] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:24 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:24.766089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:24.766705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:24.774080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:24.774565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:24.775344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:24.775790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:25.014930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:25.022770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-29d5830e-4ed6-47b6-8109-f1157b8a32db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1680 microversion: 2.1 time: 0.260643 Jun 03 16:23:25.023357 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 483/942] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:24 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:25.292478 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:25.293081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:25.299500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:25.299961 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:25.300742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:25.301184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:25.440088 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:25.446894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-9f5fbe56-bbdd-4141-99df-5252ed9c524b req-263200d5-1b7c-4349-aa26-c51f8de1f5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "962bba3e-675b-481f-840a-f5d0d2540cb5", "name": "network-vif-deleted", "tag": "d868f766-fcef-4abb-aaea-7f4466fd0395"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:25.448003 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0a8ae1a9-8556-412f-84a8-200f4425429e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.159767 Jun 03 16:23:25.455033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-9f5fbe56-bbdd-4141-99df-5252ed9c524b req-263200d5-1b7c-4349-aa26-c51f8de1f5fb service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:25.455446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-9f5fbe56-bbdd-4141-99df-5252ed9c524b req-263200d5-1b7c-4349-aa26-c51f8de1f5fb service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:25.457920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 460/943] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:25 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:25.466448 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-9f5fbe56-bbdd-4141-99df-5252ed9c524b req-263200d5-1b7c-4349-aa26-c51f8de1f5fb service nova] Creating event network-vif-deleted:d868f766-fcef-4abb-aaea-7f4466fd0395 for instance 962bba3e-675b-481f-840a-f5d0d2540cb5 on hv-cinder-83699 Jun 03 16:23:25.472198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-9f5fbe56-bbdd-4141-99df-5252ed9c524b req-263200d5-1b7c-4349-aa26-c51f8de1f5fb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028924 Jun 03 16:23:25.473044 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 484/944] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:23:26.040646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:26.041263 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:26.043199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:26.044022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=6 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:26.050106 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:26.050556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:26.051353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:26.051799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:26.116573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:26.124056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-73de1061-f4f3-4fb7-a7c3-3e5c03e95249 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1325 microversion: 2.1 time: 0.087861 Jun 03 16:23:26.125065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 461/945] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:26 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:26.462051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:26.466223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:26.466940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:26.473881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:26.474339 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:26.475124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:26.475594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:26.615731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:26.623256 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ed790ae2-3dc2-4914-bbc4-5132e715f0dd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.162533 Jun 03 16:23:26.624122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 485/946] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:26 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:27.142083 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:27.142691 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:27.150046 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:27.150493 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:27.151255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:27.151715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:27.182492 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:27.182931 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:27.183409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lazy-loading 'fault' on Instance uuid 962bba3e-675b-481f-840a-f5d0d2540cb5 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:23:27.224424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:27.231896 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-881f62ed-bb17-4462-99d5-82fb38a546ca tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 200 len: 1330 microversion: 2.1 time: 0.093787 Jun 03 16:23:27.232457 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 462/947] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:27 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:27.641302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:27.642034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:27.650795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:27.651261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:27.652109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:27.652561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:27.782428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:27.790479 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bb8ffaaa-739c-4b2e-ad20-ea31a518ad5a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.153889 Jun 03 16:23:27.791047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 486/948] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:27 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:28.249355 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:28.250115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:28.257188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:28.257639 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:28.258405 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:28.258842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:28.272286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 HTTP/1.1 Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:23:28.273926 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:23:28.275570 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '962bba3e-675b-481f-840a-f5d0d2540cb5'} Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:23:28.276350 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:23:28.277939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:23:28.279327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:23:28.279327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7f8fb870-4da1-4ac7-b748-40cb80b120e5 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 404 len: 111 microversion: 2.1 time: 0.029835 Jun 03 16:23:28.279327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 463/949] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:28 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:23:28.284331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-34f994f0-7d74-4ba3-bc9a-a45afcc07006 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '.version_select at 0x7fb5c5e0f310>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:28.302640 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-34f994f0-7d74-4ba3-bc9a-a45afcc07006 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591494786" status: 202 len: 0 microversion: 2.1 time: 0.022113 Jun 03 16:23:28.303706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 487/950] 10.222.0.41 () {58 vars in 1217 bytes} [Fri Jun 3 16:23:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591494786 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:23:28.807245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:28.808011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:28.814245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:28.814707 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:28.815648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:28.816387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:28.939283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:28.939807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:28.945874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:28.946325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:28.947100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:28.947578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:28.952063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:28.960150 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c5f08d6a-2d45-49fb-8122-2d0a1cdf56e4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.156350 Jun 03 16:23:28.960706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 464/951] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:28 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:28.963043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:29.030306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lazy-loading 'services' on Instance uuid aab42cfc-29a0-4c3f-b30b-e5902d661dd2 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:23:29.101100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7d49d5bf-6de8-4977-bd7b-b9cea468dd56 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments/d52750c5-c512-46e8-b422-4f637bf18d22" status: 202 len: 0 microversion: 2.1 time: 0.165442 Jun 03 16:23:29.110236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:29.111231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:29.115880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 488/952] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:23:28 2022] DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments/d52750c5-c512-46e8-b422-4f637bf18d22 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 16:23:29.117539 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:29.117858 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:29.118938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:29.119430 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:29.159978 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-21b1f060-b184-444a-999b-0443542cddcc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053773 Jun 03 16:23:29.160548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 465/953] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:23:29 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:23:29.978727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:29.979547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:29.981470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:29.986870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:29.987342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:29.988123 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:29.988567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.122121 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:30.129985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-74e9303a-33fb-47f5-adff-0d117bbacf3a tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.156534 Jun 03 16:23:30.130673 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 489/954] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:29 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:30.172176 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:30.173122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:30.180982 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:30.181434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.182346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:30.182775 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.214972 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8dcef9f4-323c-4f24-bdc6-6dc08c802dab tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047439 Jun 03 16:23:30.215560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 466/955] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:23:30 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:23:30.270784 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:30.271283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:30.277696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:30.278146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.278914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:30.279385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.303874 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:23:30.380869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a1c8dedd-2d9a-44d1-bd3e-01ef7108d962 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 204 len: 0 microversion: 2.1 time: 0.113719 Jun 03 16:23:30.381472 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 490/956] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:23:30 2022] DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:23:30.390751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:30.391470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:30.398190 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:30.398636 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.399416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:30.399931 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:30.524984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:30.532495 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fc21beb4-776b-4206-b51a-81997e370411 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1682 microversion: 2.1 time: 0.146463 Jun 03 16:23:30.533063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 467/957] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:30 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:31.146804 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:31.147547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:31.154051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:31.154507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:31.155283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:31.155756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:31.289614 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:31.298264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3ae39efd-e6e4-4de4-a577-4392c8739216 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.155945 Jun 03 16:23:31.299041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 491/958] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:31 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:31.425979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-3dbe5fd2-087c-43ad-b661-c6403979db6c req-aba11cc5-ced7-421c-bf66-d976a69fa134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0", "name": "network-vif-plugged", "status": "completed", "tag": "e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:31.430610 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:31.435822 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-3dbe5fd2-087c-43ad-b661-c6403979db6c req-aba11cc5-ced7-421c-bf66-d976a69fa134 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:31.436271 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-3dbe5fd2-087c-43ad-b661-c6403979db6c req-aba11cc5-ced7-421c-bf66-d976a69fa134 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:31.448423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-3dbe5fd2-087c-43ad-b661-c6403979db6c req-aba11cc5-ced7-421c-bf66-d976a69fa134 service nova] Creating event network-vif-plugged:e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1 for instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 on hv-cinder-83699 Jun 03 16:23:31.453285 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-3dbe5fd2-087c-43ad-b661-c6403979db6c req-aba11cc5-ced7-421c-bf66-d976a69fa134 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031042 Jun 03 16:23:31.453868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 468/959] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:31.549912 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:31.550556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:31.557207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:31.557633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:31.558400 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:31.558835 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:31.768780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:31.777201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e1632c09-8acc-43f9-aad3-fa5006519513 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1682 microversion: 2.1 time: 0.231194 Jun 03 16:23:31.777852 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 492/960] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:31 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:32.317581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:32.318454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:32.326187 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:32.326640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:32.327450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:32.327894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:32.465471 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:32.473211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-844d675d-3a23-4f73-92b6-b4a6ff9665c6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.160015 Jun 03 16:23:32.481681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 469/961] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:32 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:32.666331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-dc8ccdca-71cd-4e0e-9b4c-2743a6f00bc8 req-14078c77-38fa-42b0-bee0-dcd458dd737f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab42cfc-29a0-4c3f-b30b-e5902d661dd2", "name": "network-vif-deleted", "tag": "d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:32.674984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-dc8ccdca-71cd-4e0e-9b4c-2743a6f00bc8 req-14078c77-38fa-42b0-bee0-dcd458dd737f service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:32.675474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-dc8ccdca-71cd-4e0e-9b4c-2743a6f00bc8 req-14078c77-38fa-42b0-bee0-dcd458dd737f service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:32.687034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-dc8ccdca-71cd-4e0e-9b4c-2743a6f00bc8 req-14078c77-38fa-42b0-bee0-dcd458dd737f service nova] Creating event network-vif-deleted:d8561b0b-5e91-4eee-90c6-8c3b22f5b9f6 for instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 on hv-cinder-83699 Jun 03 16:23:32.691985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-dc8ccdca-71cd-4e0e-9b4c-2743a6f00bc8 req-14078c77-38fa-42b0-bee0-dcd458dd737f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029566 Jun 03 16:23:32.692580 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 493/962] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:32.794338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:32.794855 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:32.800784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:32.801234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:32.801990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:32.802421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:32.864979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:32.873063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7037a757-b949-4e4d-b556-e4ca7df26f86 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1614 microversion: 2.1 time: 0.082668 Jun 03 16:23:32.873625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 470/963] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:32 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:33.548205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:33.548923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:33.555761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:33.556221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:33.557017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:33.557464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:33.693396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:33.702606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b42fe164-bc9d-4a95-b417-08cead8a6459 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1264 microversion: 2.1 time: 0.217005 Jun 03 16:23:33.703190 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 494/964] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:33 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:33.892706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:33.894566 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:33.902968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:33.903917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:33.905497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:33.906078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:33.937259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:33.937706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:33.938151 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lazy-loading 'fault' on Instance uuid aab42cfc-29a0-4c3f-b30b-e5902d661dd2 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:23:33.977883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:33.985253 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-626ddaec-e6aa-4f78-92fb-845d666323f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 200 len: 1331 microversion: 2.1 time: 0.098791 Jun 03 16:23:33.985807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 471/965] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:33 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:34.720025 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:34.720639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:34.727150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:34.727633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:34.728394 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:34.728832 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:34.860869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:34.868501 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f3dfbf24-f260-4523-8a7f-cddbe6c9aba6 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1451 microversion: 2.1 time: 0.152482 Jun 03 16:23:34.869085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 495/966] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:34 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:34.883985 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:34.884599 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:34.890391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:34.890835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:34.891628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:34.892060 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:35.001859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:35.002597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:35.008613 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:35.009067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:35.009834 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:35.010298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:35.024411 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 HTTP/1.1 Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:23:35.026070 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:23:35.027639 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'aab42cfc-29a0-4c3f-b30b-e5902d661dd2'} Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:23:35.028678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:23:35.030138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:35.031712 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:23:35.031830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:35.032271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4f3fea25-f452-4da9-af5a-d9e3aa04cbb4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 404 len: 111 microversion: 2.1 time: 0.029461 Jun 03 16:23:35.032271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 496/967] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:34 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 16:23:35.035704 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a5ab088f-0d7a-4530-8791-af216b07e0eb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '.version_select at 0x7fb5c19429d0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:35.038166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0c05995a-a8af-42ca-bfca-20237345d6ca tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1451 microversion: 2.1 time: 0.157291 Jun 03 16:23:35.038816 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 472/968] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:34 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:35.053521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a5ab088f-0d7a-4530-8791-af216b07e0eb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729770790" status: 202 len: 0 microversion: 2.1 time: 0.021249 Jun 03 16:23:35.054096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 497/969] 10.222.0.41 () {58 vars in 1217 bytes} [Fri Jun 3 16:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729770790 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:23:35.700900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fe56252c-b086-4a7a-b6d6-5655cb038e6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: .version_select at 0x7fb5c0cf0e50>, body: {"keypair": {"name": "tempest-keypair-1133031994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANH/OX4mGdOwVoRhA5fgddpLMrzsmUWG1mr7LrogdvP/+aZKH9i3PgC53tC4L7FPCF0GnywlhJOdO3MzI9uwSEttqAH2bY+D3/w4uJKnI/XgxPM4ijqW7ctRrNOvk5VEw=="}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:35.715018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-fe56252c-b086-4a7a-b6d6-5655cb038e6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:23:35.724255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-fe56252c-b086-4a7a-b6d6-5655cb038e6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:23:35.750734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fe56252c-b086-4a7a-b6d6-5655cb038e6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053674 Jun 03 16:23:35.756997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 473/970] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:23:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:36.766306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-1e5cc2b0-f94a-41bb-ad64-aa29f8c3d5fc req-57c01abc-62e3-4a02-9046-f99581a5455c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0", "tag": "e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:36.777454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-1e5cc2b0-f94a-41bb-ad64-aa29f8c3d5fc req-57c01abc-62e3-4a02-9046-f99581a5455c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:36.778197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-1e5cc2b0-f94a-41bb-ad64-aa29f8c3d5fc req-57c01abc-62e3-4a02-9046-f99581a5455c service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:36.790177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-1e5cc2b0-f94a-41bb-ad64-aa29f8c3d5fc req-57c01abc-62e3-4a02-9046-f99581a5455c service nova] Creating event network-changed:e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1 for instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 on hv-cinder-83699 Jun 03 16:23:36.795538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-1e5cc2b0-f94a-41bb-ad64-aa29f8c3d5fc req-57c01abc-62e3-4a02-9046-f99581a5455c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034741 Jun 03 16:23:36.796689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 498/971] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:37.231772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-335975242", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb749c5-3e3e-449b-80a2-fa7c692f9d8e"}], "security_groups": [{"name": "tempest-securitygroup--1569159145"}], "key_name": "tempest-keypair-1133031994", "user_data": "}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:37.345481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] validate_networks() for [('6fb749c5-3e3e-449b-80a2-fa7c692f9d8e', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:23:37.418588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:37.419509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:37.427812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.429280 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.430342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.431017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.467612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-254752cf-1358-422c-825a-91e7e2c56eb2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments/cec29d9d-5fd3-4acd-972d-68fbbb20ddd2" status: 200 len: 194 microversion: 2.20 time: 0.063114 Jun 03 16:23:37.473169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 499/972] 10.222.0.41 () {60 vars in 1453 bytes} [Fri Jun 3 16:23:37 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments/cec29d9d-5fd3-4acd-972d-68fbbb20ddd2 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 16:23:37.536003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:37.536817 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:37.544445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.545172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.545972 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.546419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.647677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lazy-loading 'services' on Instance uuid a565de36-676c-4b81-ae49-3dfadf4dbd06 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:23:37.723248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9991d9ac-1f28-462e-ad49-9d4af48cfe6e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments/cec29d9d-5fd3-4acd-972d-68fbbb20ddd2" status: 202 len: 0 microversion: 2.20 time: 0.191234 Jun 03 16:23:37.724051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 500/973] 10.222.0.41 () {60 vars in 1456 bytes} [Fri Jun 3 16:23:37 2022] DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments/cec29d9d-5fd3-4acd-972d-68fbbb20ddd2 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 16:23:37.732980 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:37.734040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:37.740727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.741676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.742793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.743408 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.764260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:23:37.765227 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:23:37.766099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:23:37.766749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:23:37.767497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:23:37.779099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.779675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.780761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:37.781309 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:37.802781 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:23:37.806191 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-97055bc6-1308-493c-95c3-7b36d3d86550 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075224 Jun 03 16:23:37.807382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 501/974] 10.222.0.41 () {60 vars in 1342 bytes} [Fri Jun 3 16:23:37 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 16:23:37.807503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:23:37.821928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:23:37.824249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:23:37.876170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-931c56d1-c1bc-414e-9cb4-813fdced21b1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.649121 Jun 03 16:23:37.876832 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 474/975] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:23:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:23:37.886690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0e17a088-19b2-418a-977e-a90ebf183a2f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:37.887322 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0e17a088-19b2-418a-977e-a90ebf183a2f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:37.945234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0e17a088-19b2-418a-977e-a90ebf183a2f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:37.953091 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0e17a088-19b2-418a-977e-a90ebf183a2f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1241 microversion: 2.1 time: 0.070202 Jun 03 16:23:37.954137 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 502/976] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:37 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:38.818100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:38.819680 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:38.826219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:38.826666 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:38.827458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:38.827895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:38.831608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:38.859500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b7913070-f793-4ad4-8289-7bbc98ea8512 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045383 Jun 03 16:23:38.860044 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 475/977] 10.222.0.41 () {60 vars in 1342 bytes} [Fri Jun 3 16:23:38 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:23:38.969804 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:38.970529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:38.979013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:38.979523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:38.980374 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:38.980896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:39.062689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:39.070491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a250a8f3-d6d5-4324-8b83-f7e6ce407317 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1293 microversion: 2.1 time: 0.104358 Jun 03 16:23:39.071202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 503/978] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:38 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:39.871916 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:39.873001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:39.880034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:39.880531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:39.881463 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:39.882013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:39.913933 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-52867d9d-1672-4bee-9dc9-46c5fbb5eae5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046150 Jun 03 16:23:39.915036 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 476/979] 10.222.0.41 () {60 vars in 1342 bytes} [Fri Jun 3 16:23:39 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:39.976839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:39.977407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:39.983821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:39.984348 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:39.985192 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:39.985725 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:40.011502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:23:40.059214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:40.090507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:40.091318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:40.096838 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-81916ee7-410a-4f90-8175-dd341edb4b02 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 204 len: 0 microversion: 2.20 time: 0.123641 Jun 03 16:23:40.097467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 504/980] 10.222.0.41 () {60 vars in 1279 bytes} [Fri Jun 3 16:23:39 2022] DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 16:23:40.101834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:40.102226 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:40.103850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:40.104598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:40.107711 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:40.108389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:40.115693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:40.116144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:40.116921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:40.117359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:40.248681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:40.257489 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b2849f39-9422-4d1c-98e2-8f9dc85b82f9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.173493 Jun 03 16:23:40.258186 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 477/981] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:40 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:40.319800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:40.327890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:40.329414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:40.330670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3adc9aff-1d9f-4c52-8cc7-728703a89da9 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.227364 Jun 03 16:23:40.331132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 505/982] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:40 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:23:40.838344 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-05e58e13-d450-4e31-a5bc-3c2ffc642e9d req-05793599-d439-499e-a166-c23382b1badf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4c2c92-9f7a-4f64-ba0e-afc94658a59e", "tag": "3b6e2361-79f3-49b0-80a2-5cad14ec6e44"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:40.847591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-05e58e13-d450-4e31-a5bc-3c2ffc642e9d req-05793599-d439-499e-a166-c23382b1badf service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:40.848051 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-05e58e13-d450-4e31-a5bc-3c2ffc642e9d req-05793599-d439-499e-a166-c23382b1badf service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:40.862119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-05e58e13-d450-4e31-a5bc-3c2ffc642e9d req-05793599-d439-499e-a166-c23382b1badf service nova] Creating event network-changed:3b6e2361-79f3-49b0-80a2-5cad14ec6e44 for instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e on hv-cinder-83699 Jun 03 16:23:40.867200 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-05e58e13-d450-4e31-a5bc-3c2ffc642e9d req-05793599-d439-499e-a166-c23382b1badf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033868 Jun 03 16:23:40.867842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 478/983] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:41.274228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:41.274841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:41.281697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:41.282152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:41.282924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:41.283390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:41.351105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:41.351827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:41.357891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:41.358344 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:41.359107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:41.359573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:41.411718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:41.420005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1a3f50d9-6413-4fdc-8c25-cec57235adbe tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.149521 Jun 03 16:23:41.420585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 506/984] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:41 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:41.501663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:41.510278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:41.511751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:41.512924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c44a7022-9b38-49fe-9e4f-1d2a27daaa20 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.167095 Jun 03 16:23:41.513486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 479/985] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:41 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:23:42.438685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:42.438685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:42.445188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:42.445642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:42.446424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:42.446872 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:42.532554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:42.533755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:42.540847 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:42.542069 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:42.542996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:42.543476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:42.675980 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:42.684936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-639acc57-4f59-422c-9771-c404fe626d7d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.251876 Jun 03 16:23:42.685510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 507/986] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:42 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:42.772146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:42.780354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:42.781865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:42.783099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e0651270-7e22-4843-8937-8dc2747cf17f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1721 microversion: 2.20 time: 0.254470 Jun 03 16:23:42.783695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 480/987] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:42 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:23:43.326683 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-c50739f2-13b8-4ca6-bf75-bab1506f0b3f req-096910cc-d56d-4b0e-8570-10194f50ffbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a565de36-676c-4b81-ae49-3dfadf4dbd06", "name": "network-vif-deleted", "tag": "e842e8b9-3bd1-4f5c-ad08-f8f45d991022"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:43.334643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-c50739f2-13b8-4ca6-bf75-bab1506f0b3f req-096910cc-d56d-4b0e-8570-10194f50ffbf service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:43.335091 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-c50739f2-13b8-4ca6-bf75-bab1506f0b3f req-096910cc-d56d-4b0e-8570-10194f50ffbf service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:43.346121 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-c50739f2-13b8-4ca6-bf75-bab1506f0b3f req-096910cc-d56d-4b0e-8570-10194f50ffbf service nova] Creating event network-vif-deleted:e842e8b9-3bd1-4f5c-ad08-f8f45d991022 for instance a565de36-676c-4b81-ae49-3dfadf4dbd06 on hv-cinder-83699 Jun 03 16:23:43.351574 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-c50739f2-13b8-4ca6-bf75-bab1506f0b3f req-096910cc-d56d-4b0e-8570-10194f50ffbf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028482 Jun 03 16:23:43.352344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 508/988] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:43.701962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:43.702507 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:43.709434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:43.709887 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:43.710655 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:43.711098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:43.806386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:43.807006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:43.813484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:43.813944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:43.814723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:43.815195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:43.844535 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:43.853221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-afb4dd7c-efa8-42ae-9ee7-c5291cad0aff tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.155085 Jun 03 16:23:43.853800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 481/989] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:43 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:43.891056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:43.900144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:43.901699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:43.902870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-98fa487c-34ca-48af-b9cd-71fcdae6d638 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1654 microversion: 2.20 time: 0.101420 Jun 03 16:23:43.903459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 509/990] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:43 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:23:44.869945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:44.870593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:44.877171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:44.877625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:44.878396 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:44.878837 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:44.921824 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:44.922449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:44.929352 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:44.929809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:44.930595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:44.931044 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:44.992621 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:45.000616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:45.002169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:45.003356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5ba98e95-709e-4b48-8795-2a24900a1006 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1654 microversion: 2.20 time: 0.085505 Jun 03 16:23:45.003925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 510/991] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:44 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1654 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:23:45.007885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:45.015245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fa1ceed5-42f9-427d-ab9f-3ea49a9aa746 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.149147 Jun 03 16:23:45.015830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 482/992] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:44 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:46.022926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:46.023579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:46.034074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:46.035522 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:46.040214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:46.040671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:46.041468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:46.042370 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:46.051908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:46.052493 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:46.053286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:46.053730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:46.077361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:46.077825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:46.078288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lazy-loading 'fault' on Instance uuid a565de36-676c-4b81-ae49-3dfadf4dbd06 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:23:46.132761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:46.144010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:46.145693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:46.147434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-da81f51d-45e0-4155-8b59-43399cc84045 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 200 len: 1370 microversion: 2.20 time: 0.129426 Jun 03 16:23:46.148198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 511/993] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:46 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 1370 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:46.199319 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:46.206667 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-30c7e75f-8e81-4954-b4a4-88e6f4c8259a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.177858 Jun 03 16:23:46.207229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 483/994] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:46 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:47.166479 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:47.167088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:47.173656 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:47.174100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:47.174867 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:47.175327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:47.188269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] HTTP exception thrown: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Request method failure captured: Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 HTTP/1.1 Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO1qJdc5HSPiyGYIbfcQQ53UwGfShPWCjOCw9AKYzOya6O6bldKYqSFi7wvUZwj9r7hsAGThk1EGJlzVSaqaS7hPIFztm5Qpk3GVRrJk_drazfeItq2rGwDfEpczZig9AkQE7NKsTbUWtpB1Amav43aBkzx_9MQbhD_gqUzYhcoodc Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:23:47.189883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffa464e4d2264df68897a6d4b8dc7aab"}]}] Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 94f91ae071b24e31a8ef8d50933ba4fb Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:23:47.191337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'a565de36-676c-4b81-ae49-3dfadf4dbd06'} Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:23:47.192088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:23:47.194122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:23:47.195854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Returning 404 to user: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:23:47.195854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c4f02fb2-03cd-4c7d-a1eb-b405ebbe4204 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 404 len: 111 microversion: 2.20 time: 0.028694 Jun 03 16:23:47.195854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 512/995] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:47 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:23:47.200488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0066488c-7c6c-47d5-b0b1-630b485b9544 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '.version_select at 0x7fb5c181ae50>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:47.220949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0066488c-7c6c-47d5-b0b1-630b485b9544 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-127922057" status: 204 len: 0 microversion: 2.20 time: 0.024255 Jun 03 16:23:47.221525 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 484/996] 10.222.0.41 () {60 vars in 1258 bytes} [Fri Jun 3 16:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-127922057 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 16:23:47.223488 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:47.224112 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:47.230508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:47.230969 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:47.231782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:47.232234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:47.367508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:47.378297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-334d9d69-6dfd-425f-9aea-18499f54f37a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.158650 Jun 03 16:23:47.379165 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 513/997] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:47 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:47.525516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-9d2a478c-e3f2-418e-9cfd-8e538b5c9f39 req-dfeb1ff8-1869-43a1-a81d-9628a7b7e0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4c2c92-9f7a-4f64-ba0e-afc94658a59e", "name": "network-vif-plugged", "status": "completed", "tag": "3b6e2361-79f3-49b0-80a2-5cad14ec6e44"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:47.534889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-9d2a478c-e3f2-418e-9cfd-8e538b5c9f39 req-dfeb1ff8-1869-43a1-a81d-9628a7b7e0a2 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:47.535635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-9d2a478c-e3f2-418e-9cfd-8e538b5c9f39 req-dfeb1ff8-1869-43a1-a81d-9628a7b7e0a2 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:47.546569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-9d2a478c-e3f2-418e-9cfd-8e538b5c9f39 req-dfeb1ff8-1869-43a1-a81d-9628a7b7e0a2 service nova] Creating event network-vif-plugged:3b6e2361-79f3-49b0-80a2-5cad14ec6e44 for instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e on hv-cinder-83699 Jun 03 16:23:47.551270 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-9d2a478c-e3f2-418e-9cfd-8e538b5c9f39 req-dfeb1ff8-1869-43a1-a81d-9628a7b7e0a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029785 Jun 03 16:23:47.552050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 485/998] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:47.894729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dab51b1d-1518-4063-b05b-3260dc846c0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'create', calling method: .version_select at 0x7fb5c0e29c10>, body: {"keypair": {"name": "tempest-keypair-873587406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNA/57mmqPKAqSWJ/YuYfddG2tS9qHm45mpgV5DMtnmymi2w/U5qAAbRreedz9ZOPWLV3XnEVzUaINQkeGeR8kPLpbNt73k4KtwYmSIjHUnkGopNbzlVFgt26zbAYgW6A=="}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:47.908816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-dab51b1d-1518-4063-b05b-3260dc846c0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:23:47.913156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-dab51b1d-1518-4063-b05b-3260dc846c0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for user 94f91ae071b24e31a8ef8d50933ba4fb and project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'key_pairs'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:23:47.935206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dab51b1d-1518-4063-b05b-3260dc846c0e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044636 Jun 03 16:23:47.935827 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 514/999] 10.222.0.41 () {62 vars in 1199 bytes} [Fri Jun 3 16:23:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 16:23:48.393042 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:48.394154 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=10 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:48.399271 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:48.400015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:48.407445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:48.407901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:48.408686 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:48.409127 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:48.762761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:48.770466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0583771e-7d3f-4796-b530-0f823b72ae02 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1367 microversion: 2.1 time: 0.378376 Jun 03 16:23:48.771227 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 486/1000] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:48 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:23:49.512067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-311125072", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aac77ef2-24df-4348-b770-e983d0529c48"}], "security_groups": [{"name": "tempest-securitygroup--1002115210"}], "key_name": "tempest-keypair-873587406", "user_data": "}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:49.612002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] validate_networks() for [('aac77ef2-24df-4348-b770-e983d0529c48', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:23:49.787015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:49.787651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:49.794390 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:49.794840 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:49.795648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:49.796087 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:49.940601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:49.949812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-60e827ee-b03b-40d7-a0eb-bf49d9b9009d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1557 microversion: 2.1 time: 0.166542 Jun 03 16:23:49.950436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 487/1001] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:23:49 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:23:49.967045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:49.967504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:49.973855 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:49.974315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:49.975085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:49.975546 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:50.003111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:23:50.003579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:23:50.004059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:23:50.004741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:23:50.005774 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:23:50.016207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:50.016892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:50.017710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:50.018149 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:50.035976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:23:50.040152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Getting quotas for user 94f91ae071b24e31a8ef8d50933ba4fb and project ffa464e4d2264df68897a6d4b8dc7aab. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:23:50.051389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:23:50.054207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:23:50.064482 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7cdcb255-089d-474c-a4f6-89bbff75a586 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102103 Jun 03 16:23:50.065393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 488/1002] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:23:49 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:23:50.105074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-13c30c13-dffb-4fd6-b28c-2a269c489ea8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.597353 Jun 03 16:23:50.105904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 515/1003] 10.222.0.41 () {62 vars in 1187 bytes} [Fri Jun 3 16:23:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 16:23:50.116394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ccdc6556-5335-4247-ac27-c8b7f2964790 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:50.117013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ccdc6556-5335-4247-ac27-c8b7f2964790 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:50.225249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ccdc6556-5335-4247-ac27-c8b7f2964790 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:50.234592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ccdc6556-5335-4247-ac27-c8b7f2964790 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:50.236293 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ccdc6556-5335-4247-ac27-c8b7f2964790 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:50.237406 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ccdc6556-5335-4247-ac27-c8b7f2964790 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1280 microversion: 2.20 time: 0.125730 Jun 03 16:23:50.246806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 489/1004] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:50 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:51.020313 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-490061a4-4ecc-413c-b811-ed66d97a51eb req-50f3ff8f-f9e0-416f-b572-f8d423ca89dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4c2c92-9f7a-4f64-ba0e-afc94658a59e", "tag": "3b6e2361-79f3-49b0-80a2-5cad14ec6e44"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:51.029297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-490061a4-4ecc-413c-b811-ed66d97a51eb req-50f3ff8f-f9e0-416f-b572-f8d423ca89dc service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:51.029799 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-490061a4-4ecc-413c-b811-ed66d97a51eb req-50f3ff8f-f9e0-416f-b572-f8d423ca89dc service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:51.041360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-490061a4-4ecc-413c-b811-ed66d97a51eb req-50f3ff8f-f9e0-416f-b572-f8d423ca89dc service nova] Creating event network-changed:3b6e2361-79f3-49b0-80a2-5cad14ec6e44 for instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e on hv-cinder-83699 Jun 03 16:23:51.046140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-490061a4-4ecc-413c-b811-ed66d97a51eb req-50f3ff8f-f9e0-416f-b572-f8d423ca89dc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030262 Jun 03 16:23:51.046721 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 516/1005] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:51.256908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:51.263451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:51.274771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:51.275221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:51.276034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:51.276472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:51.354206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:51.362084 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:51.363626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:51.365260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d2368b00-2c8f-474c-9b20-acd9fef83bd6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1338 microversion: 2.20 time: 0.112699 Jun 03 16:23:51.365877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 490/1006] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:51 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:52.384859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:52.385746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:52.387800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:23:52.394563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:52.395351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:52.396913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:52.397470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:52.532306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:52.540600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:52.542140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:52.543239 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-10f6d335-7ba2-473b-b975-1248f5c21777 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.163831 Jun 03 16:23:52.543970 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 517/1007] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:52 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:53.062301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-772a4e85-e52a-46f5-aadd-f41659e2bfe1 req-3ebe5712-45c8-42a4-a18e-141ff6814400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:53.071953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-772a4e85-e52a-46f5-aadd-f41659e2bfe1 req-3ebe5712-45c8-42a4-a18e-141ff6814400 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:53.072397 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-772a4e85-e52a-46f5-aadd-f41659e2bfe1 req-3ebe5712-45c8-42a4-a18e-141ff6814400 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:53.084487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-772a4e85-e52a-46f5-aadd-f41659e2bfe1 req-3ebe5712-45c8-42a4-a18e-141ff6814400 service nova] Creating event network-changed:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:23:53.089322 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-772a4e85-e52a-46f5-aadd-f41659e2bfe1 req-3ebe5712-45c8-42a4-a18e-141ff6814400 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031188 Jun 03 16:23:53.089924 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 491/1008] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:23:53.560981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:53.561506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:53.568603 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:53.569050 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:53.569815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:53.570252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:53.707897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:53.716076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:53.717623 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:53.718732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7e11f585-fe69-436d-8866-4e7e7906b38d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.161826 Jun 03 16:23:53.719310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 518/1009] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:53 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:54.737622 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:54.738324 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:54.744555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:54.745007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:54.745769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:54.746209 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:54.873096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:54.882118 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:54.883887 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:54.885127 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9025366d-b610-4ce3-bffe-83abb6942226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.152290 Jun 03 16:23:54.885684 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 492/1010] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:54 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:55.903241 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:55.903885 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:55.910458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:55.910920 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:55.911727 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:55.912199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:56.038748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:56.046680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:56.048240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:56.049379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-62ea77b0-8b9e-4c27-b2ba-12626cbcbb90 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.150036 Jun 03 16:23:56.049933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 519/1011] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:55 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:57.067683 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:57.068292 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:57.075021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:57.075558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:57.076387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:57.076859 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:57.207434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:57.215831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:57.217361 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:57.218468 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-76d91a40-51f8-4ed2-8f9c-6bdf4e0114ea tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.154719 Jun 03 16:23:57.219033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 493/1012] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:57 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:58.236270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:58.236890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:58.243507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:58.243963 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:58.244742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:58.245187 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:58.369957 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:58.377797 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:58.379336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:58.380952 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-eb5c7402-243b-4cc0-8580-c21c8b4c4447 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.148735 Jun 03 16:23:58.381510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 520/1013] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:58 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:59.399445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:23:59.400059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:23:59.406095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:59.406544 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:59.407331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:59.407776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:59.537077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:59.544938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:59.546447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:23:59.547585 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-27d3e1c6-6735-48a9-a37e-bbb31063d924 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.152268 Jun 03 16:23:59.548163 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 494/1014] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:23:59 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:23:59.581047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-f248f2cd-6074-4b22-8058-07358581e9c1 req-5aec1c1f-3528-43d4-9ccd-942a0a8650b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "name": "network-vif-plugged", "status": "completed", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:23:59.590148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-f248f2cd-6074-4b22-8058-07358581e9c1 req-5aec1c1f-3528-43d4-9ccd-942a0a8650b5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:23:59.590492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-f248f2cd-6074-4b22-8058-07358581e9c1 req-5aec1c1f-3528-43d4-9ccd-942a0a8650b5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:23:59.602269 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-f248f2cd-6074-4b22-8058-07358581e9c1 req-5aec1c1f-3528-43d4-9ccd-942a0a8650b5 service nova] Creating event network-vif-plugged:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:23:59.607018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-f248f2cd-6074-4b22-8058-07358581e9c1 req-5aec1c1f-3528-43d4-9ccd-942a0a8650b5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 Jun 03 16:23:59.607646 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 521/1015] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:00.565544 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:00.566099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:00.568680 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:00.574713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:00.575164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:00.575965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:00.576402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:00.702856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:00.710721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:00.712264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:00.713369 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-abef3f82-2c50-4581-92c6-c40ef26f9d49 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1406 microversion: 2.20 time: 0.151812 Jun 03 16:24:00.713929 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 495/1016] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:24:00 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:24:01.729406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:01.730268 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=12 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:01.734875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:01.735597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:01.743065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:01.743540 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:01.744312 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:01.744748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:01.875123 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:01.883461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:01.884960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:01.886106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3d149cae-8d78-4c03-961a-893406bd75f2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1598 microversion: 2.20 time: 0.157683 Jun 03 16:24:01.886647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 522/1017] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:24:01 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:24:01.903324 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:01.903785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:01.910156 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:01.910606 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:01.911403 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:01.911841 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:01.915375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:01.990571 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-932d33b7-e03e-4def-bb1f-40205eee7eba tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091138 Jun 03 16:24:01.991174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 496/1018] 10.222.0.41 () {60 vars in 1315 bytes} [Fri Jun 3 16:24:01 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:24:02.870184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-bf9682b3-311b-4bd9-9e8b-cd13670c878c req-ca923ff2-e687-4674-aff5-851db8a81ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:02.878694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-bf9682b3-311b-4bd9-9e8b-cd13670c878c req-ca923ff2-e687-4674-aff5-851db8a81ddb service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:02.879146 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-bf9682b3-311b-4bd9-9e8b-cd13670c878c req-ca923ff2-e687-4674-aff5-851db8a81ddb service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:02.890554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-bf9682b3-311b-4bd9-9e8b-cd13670c878c req-ca923ff2-e687-4674-aff5-851db8a81ddb service nova] Creating event network-changed:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:24:02.895651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-bf9682b3-311b-4bd9-9e8b-cd13670c878c req-ca923ff2-e687-4674-aff5-851db8a81ddb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029290 Jun 03 16:24:02.897110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 523/1019] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:25.118995 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:25.119757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:25.123815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:25.124758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:25.131676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:25.132125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:25.132875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:25.133306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:25.203540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-be4e2732-890d-498a-9546-ab5215d57b63 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/action" status: 202 len: 0 microversion: 2.1 time: 0.085633 Jun 03 16:24:25.204192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 497/1020] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:24:25 2022] POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:24:25.210703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=13 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:25.211475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:25.216290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:25.216999 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:25.225718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:25.225718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:25.226591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:25.227088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:25.371042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:25.379158 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1084c609-8110-4794-9127-245dfb9722da tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1751 microversion: 2.1 time: 0.170623 Jun 03 16:24:25.379987 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 524/1021] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:25 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:26.398946 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:26.399671 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:26.405904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:26.406347 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:26.407102 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:26.407558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:26.549035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:26.557395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5c476559-a340-4ff2-b687-b15116c356cb tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.163950 Jun 03 16:24:26.557954 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 498/1022] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:26 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:27.574620 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:27.575175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:27.581689 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:27.582148 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:27.582925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:27.583407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:27.723262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:27.731207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d545497c-6340-43fa-be59-da2cdd80b792 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.160546 Jun 03 16:24:27.731800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 525/1023] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:27 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:28.748680 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:28.749292 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:28.755474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:28.755919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:28.756698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:28.757132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:28.900623 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:28.908474 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-def032dd-cfc7-4623-b5fa-a05789e30b67 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.163582 Jun 03 16:24:28.909032 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 499/1024] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:28 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:29.553921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:29.554421 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:29.560811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:29.561264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:29.562034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:29.562473 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:29.639864 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lazy-loading 'services' on Instance uuid 58b7d211-5b5b-4d26-aa96-cb295c20451d {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:24:29.709728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bd9ee55f-9b17-47cc-9b52-ae3758cdc6bc tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments/fd20b736-af2b-4485-a3c0-9fe7b081868d" status: 202 len: 0 microversion: 2.1 time: 0.159450 Jun 03 16:24:29.710311 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 526/1025] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:24:29 2022] DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments/fd20b736-af2b-4485-a3c0-9fe7b081868d => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:24:29.718674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:29.719748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:29.726771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:29.727232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:29.728037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:29.728476 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:29.758528 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-324724f9-9176-4af4-9181-7556331a5bc3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Jun 03 16:24:29.759130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 500/1026] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:24:29 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:29.925310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:29.926016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:29.932319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:29.932777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:29.933557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:29.933998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:30.074015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:30.081839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-59f845f2-90ed-4fca-be48-7ecc06a81f6e tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.160776 Jun 03 16:24:30.082388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 527/1027] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:29 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:30.770411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:30.771913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:30.778206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:30.778651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:30.779436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:30.779872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:30.806983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-027b93ca-9f90-4407-929b-f85c72a8dd1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040906 Jun 03 16:24:30.807558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 501/1028] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:24:30 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:24:30.877093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:30.877607 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:30.884829 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:30.885314 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:30.886099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:30.886540 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:30.912181 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:24:30.987327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-411122e9-7c24-4b79-ad18-718f9e86486b tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 204 len: 0 microversion: 2.1 time: 0.113730 Jun 03 16:24:30.987978 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 528/1029] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:24:30 2022] DELETE /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:24:30.996233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:30.996877 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:31.002834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.004078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.004517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.099666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:31.100380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:31.108036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.108497 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.109323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.109767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.137933 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:31.146666 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-37c515de-623b-4d61-91bc-c404a849d5b7 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1690 microversion: 2.1 time: 0.154231 Jun 03 16:24:31.147240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 502/1030] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:30 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:31.175248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:31.176401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:31.183035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.183521 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.184299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.184738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.213583 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-928dc930-acf6-4e75-bb9f-42efd1eaf6f0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042245 Jun 03 16:24:31.214149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 503/1031] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:24:31 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 16:24:31.270577 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:31.271122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:31.271675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:31.277141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.277593 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.278356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.278794 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.279784 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-860a3709-6c32-46b2-8bf0-24e26333ad04 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.184611 Jun 03 16:24:31.280357 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 529/1032] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:31 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:31.304393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:24:31.378105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6364f65b-32f9-4130-ac81-17cf52716323 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 204 len: 0 microversion: 2.1 time: 0.111333 Jun 03 16:24:31.378681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 504/1033] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:24:31 2022] DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 16:24:31.387260 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:31.387896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:31.394013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.394461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.395217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:31.395678 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:31.519751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:31.527710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3085fe3f-b6eb-4c7f-9207-957a0aac02ae tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1673 microversion: 2.1 time: 0.144257 Jun 03 16:24:31.528267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 530/1034] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:31 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:32.165006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:32.165708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:32.172117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:32.172566 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:32.173318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:32.173752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:32.296997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:32.297614 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:32.304696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:32.305170 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:32.305934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:32.306203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:32.306378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:32.313769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-dabf5196-6ab8-48f2-be4b-6cab971e3e5f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1690 microversion: 2.1 time: 0.153459 Jun 03 16:24:32.323345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 505/1035] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:32 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:32.442177 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:32.450093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2c67aeee-e1bf-4f44-bd6e-79a76f380e48 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.156973 Jun 03 16:24:32.450687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 531/1036] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:32 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:32.544554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:32.545161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:32.551036 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:32.551526 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:32.552284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:32.552719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:32.677113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:32.684501 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ee789716-c201-4995-9fc9-6c739e3ad61f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1673 microversion: 2.1 time: 0.143712 Jun 03 16:24:32.685090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 506/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:32 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:33.330201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:33.330818 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:33.337305 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:33.337812 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:33.338537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:33.338985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:33.467750 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:33.468402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:33.468561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:33.475581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:33.476028 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:33.476803 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:33.477031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-06899c3d-39d5-461c-81c6-c1606795d05d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1690 microversion: 2.1 time: 0.150703 Jun 03 16:24:33.477236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:33.477606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 532/1038] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:33 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:33.619466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:33.627204 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f40f8f5c-f446-4838-af9c-7c0ab093ed5f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.163358 Jun 03 16:24:33.627801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 507/1039] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:33 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:33.701404 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:33.702022 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:33.708056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:33.709090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:33.709858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:33.710300 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:33.841983 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:33.849458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-34558353-cb46-468b-a5eb-1d13cd1f2390 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1673 microversion: 2.1 time: 0.151869 Jun 03 16:24:33.850023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 533/1040] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:33 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:34.496879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:34.497517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:34.504146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:34.504541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:34.505806 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:34.506237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:34.645325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:34.646615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:34.652666 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:34.653125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:34.653910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:34.654351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:34.716644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:34.724380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-504fc65c-1eee-4cee-894d-c29c86646197 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1690 microversion: 2.1 time: 0.231420 Jun 03 16:24:34.724959 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 508/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:34 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1690 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:34.799125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:34.807538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dc5bd797-b839-4c8f-a72f-2171742776a7 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.166419 Jun 03 16:24:34.808126 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 534/1042] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:34 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:34.866295 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:34.866913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:34.873173 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:34.873625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:34.874412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:34.874851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:35.363741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:35.371767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e60aacb7-6fe4-4eb8-b65e-205ff0730997 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1673 microversion: 2.1 time: 0.509398 Jun 03 16:24:35.372346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 509/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:34 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1673 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:35.742186 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:35.742800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:35.749428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:35.749877 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:35.750648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:35.751085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:35.814043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:35.823470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bee14eda-71da-49d9-a155-3452bde10393 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1622 microversion: 2.1 time: 0.085799 Jun 03 16:24:35.824036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 535/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:35 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:35.824328 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:35.825059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:35.831835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:35.832667 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:35.833527 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:35.834128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.222477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:36.238503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-d55cc204-5441-4db9-b3d7-dff9938b44a0 req-33f91fc5-2e69-4e78-880c-becedb6711f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b7d211-5b5b-4d26-aa96-cb295c20451d", "name": "network-vif-deleted", "tag": "00ec2058-4aa7-4f71-a6fa-0278283989c0"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:36.244796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:36.251172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-d55cc204-5441-4db9-b3d7-dff9938b44a0 req-33f91fc5-2e69-4e78-880c-becedb6711f4 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:36.252434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c5c67d22-e9d5-4f74-b3bd-50db208fd418 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.432246 Jun 03 16:24:36.253374 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 510/1045] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:35 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:36.253682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-d55cc204-5441-4db9-b3d7-dff9938b44a0 req-33f91fc5-2e69-4e78-880c-becedb6711f4 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.272344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-d55cc204-5441-4db9-b3d7-dff9938b44a0 req-33f91fc5-2e69-4e78-880c-becedb6711f4 service nova] Creating event network-vif-deleted:00ec2058-4aa7-4f71-a6fa-0278283989c0 for instance 58b7d211-5b5b-4d26-aa96-cb295c20451d on hv-cinder-83699 Jun 03 16:24:36.278008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-d55cc204-5441-4db9-b3d7-dff9938b44a0 req-33f91fc5-2e69-4e78-880c-becedb6711f4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043185 Jun 03 16:24:36.279569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 536/1046] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:36.394079 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:36.394723 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:36.401650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:36.402107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.402888 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:36.403341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.519133 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:36.528386 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a2b77f1f-dfeb-4478-8655-00e362d5fa59 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 200 len: 1605 microversion: 2.1 time: 0.142902 Jun 03 16:24:36.529301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 511/1047] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:36 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:36.841325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:36.844909 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:36.855407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:36.856308 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.857367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:36.858032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.904201 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:36.904655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:36.905110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lazy-loading 'fault' on Instance uuid 58b7d211-5b5b-4d26-aa96-cb295c20451d {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:24:36.954332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:36.961869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4ed65a6e-e5be-4ff2-9980-6f48f4369ef5 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 200 len: 1334 microversion: 2.1 time: 0.125275 Jun 03 16:24:36.962844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 537/1048] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:36 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 1334 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:37.269530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:37.270141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:37.277853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:37.278505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:37.279286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:37.279737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:37.443134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:37.451210 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-bb8850f5-f21e-4002-a202-79bcbb17dfaa tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.185729 Jun 03 16:24:37.451827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 512/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:37 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:37.546058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:37.546670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:37.552557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:37.553008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:37.553779 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:37.554215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:37.568392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] HTTP exception thrown: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Request method failure captured: Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad HTTP/1.1 Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjPB7gIXbgTPvleMb9NQUSdMkgchOItGqKs5OdLDOY9uoXg9N_FVWu_ZI-pE9g_mXrFBRHqH-tQRf32yFTgsy3j9eirUd-0JYxLtvTFFzn2KYzYzkGGd-D9wr6csOzllT3nlny9wL7PKNQmTgaXuuxf_xgxPqtf34h0Y6vz98lLQ2wk Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: d0f59694966848829048aee648dddccc Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:24:37.570062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d0f59694966848829048aee648dddccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d0f59694966848829048aee648dddccc"}]}] Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: d0f59694966848829048aee648dddccc Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: c68189df1f9b4f9aacfa319381849697 Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:24:37.571707 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '2de1f638-4fee-41e2-bd50-b802f8494fad'} Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:24:37.572548 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:24:37.573988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:37.575119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Returning 404 to user: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:24:37.575119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0a10b7e8-cf8b-4c71-9574-1931e70b23fa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 404 len: 111 microversion: 2.1 time: 0.029297 Jun 03 16:24:37.575119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 538/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:37 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:24:37.580353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-95b6ec55-0387-49ec-82c5-aa41b115634d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '.version_select at 0x7fb5c17ae4c0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:37.597801 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-95b6ec55-0387-49ec-82c5-aa41b115634d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879553497" status: 202 len: 0 microversion: 2.1 time: 0.021249 Jun 03 16:24:37.598364 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 513/1051] 10.222.0.41 () {58 vars in 1217 bytes} [Fri Jun 3 16:24:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879553497 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:24:37.977844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:37.978454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 58b7d211-5b5b-4d26-aa96-cb295c20451d] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:37.984829 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:37.985277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:37.986045 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:37.986480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:37.990962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:38.001559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] HTTP exception thrown: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d could not be found. Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Request method failure captured: Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d HTTP/1.1 Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO8CvWPyoGUGP7589mDfybb0r4x4SIfyl7oWrTkzfwNMVxJ7YY4L7okSJ02orQcqE8viW_VKf4NFF1cBpsNksHfWkEQkayTtL_IkXahuioGHODuDL3RAH7U6m7Q3fq_LgXhmBUPe5Yfc6LwvahIygeKT0ma-hZUV8Mpyy_dVOHpRiA Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:24:38.003219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1443b802dc724950b5eb5c6446e2515c"}]}] Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 4206a21c317e4b5aace8541699f8032d Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d could not be found. Jun 03 16:24:38.004823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '58b7d211-5b5b-4d26-aa96-cb295c20451d'} Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d could not be found. Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:24:38.006251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d could not be found. Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d could not be found. Jun 03 16:24:38.007494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:38.008570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Returning 404 to user: Instance 58b7d211-5b5b-4d26-aa96-cb295c20451d could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:24:38.008570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-793dc9a3-7a8a-481f-a9e1-47d66705c0e8 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d" status: 404 len: 111 microversion: 2.1 time: 0.030683 Jun 03 16:24:38.008570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 539/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:37 2022] GET /compute/v2.1/servers/58b7d211-5b5b-4d26-aa96-cb295c20451d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:24:38.014161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-75720bf8-3865-445b-802d-76801fb45e19 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '.version_select at 0x7fb5c0cf00d0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:38.031756 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-75720bf8-3865-445b-802d-76801fb45e19 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525613816" status: 202 len: 0 microversion: 2.1 time: 0.021090 Jun 03 16:24:38.032793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 514/1053] 10.222.0.41 () {58 vars in 1217 bytes} [Fri Jun 3 16:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525613816 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:24:38.297660 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-48ca5a5c-f79e-485b-b485-22fb4e1ed708 req-27e12425-9007-4e30-a3ce-cf3814f60e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de1f638-4fee-41e2-bd50-b802f8494fad", "name": "network-vif-deleted", "tag": "fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:38.311015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-48ca5a5c-f79e-485b-b485-22fb4e1ed708 req-27e12425-9007-4e30-a3ce-cf3814f60e54 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:38.311919 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-48ca5a5c-f79e-485b-b485-22fb4e1ed708 req-27e12425-9007-4e30-a3ce-cf3814f60e54 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:38.323638 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b93fad01-0e30-452b-be37-3d6029981010 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: .version_select at 0x7fb5c0d480d0>, body: {"keypair": {"name": "tempest-keypair-1447900901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbcu6EQWx+YwzfNAkXUoxlRcBjB5t5RQrHfACdM7f+7gqshvYXBzxPAGVZup8DBdkAefkDZsPrKku2LoS3bsyXn7XY4KYcakcNUy/XzRBAG0ixqhdSMaLkMlxbNnFjAzw=="}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:38.342069 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-48ca5a5c-f79e-485b-b485-22fb4e1ed708 req-27e12425-9007-4e30-a3ce-cf3814f60e54 service nova] Creating event network-vif-deleted:fc6b1ba7-2a39-4c6c-a836-ee8d66ad975c for instance 2de1f638-4fee-41e2-bd50-b802f8494fad on hv-cinder-83699 Jun 03 16:24:38.350823 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-48ca5a5c-f79e-485b-b485-22fb4e1ed708 req-27e12425-9007-4e30-a3ce-cf3814f60e54 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057521 Jun 03 16:24:38.352031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 540/1054] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:38.355641 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-b93fad01-0e30-452b-be37-3d6029981010 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for project d0f59694966848829048aee648dddccc. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:24:38.360901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-b93fad01-0e30-452b-be37-3d6029981010 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for user c68189df1f9b4f9aacfa319381849697 and project d0f59694966848829048aee648dddccc. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:24:38.384706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b93fad01-0e30-452b-be37-3d6029981010 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064961 Jun 03 16:24:38.385320 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 515/1055] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:24:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:38.469825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:38.470560 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:38.478616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:38.479210 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:38.480025 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:38.480459 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:38.645060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:38.653680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-310b4054-b102-4a1a-913d-e2852dd4dd50 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1756 microversion: 2.1 time: 0.188485 Jun 03 16:24:38.654246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 541/1056] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:38 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:39.672428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:39.673128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:39.679219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:39.679796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:39.680572 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:39.681016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:39.823678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:39.831811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d408e537-406c-44e0-ab49-66fcd5aed0d9 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1759 microversion: 2.1 time: 0.163962 Jun 03 16:24:39.832388 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 516/1057] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:39 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:39.855688 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1250424864", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c3619401-b67f-424d-9ca5-3555aafbaad6"}], "security_groups": [{"name": "tempest-securitygroup--1441743079"}], "key_name": "tempest-keypair-1447900901", "user_data": "}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:39.956055 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] validate_networks() for [('c3619401-b67f-424d-9ca5-3555aafbaad6', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:24:40.318452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:24:40.318882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:24:40.319389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:24:40.319808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:24:40.320222 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:24:40.328913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:40.329413 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:40.330222 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:40.330658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:40.347831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for project d0f59694966848829048aee648dddccc. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:24:40.351795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Getting quotas for user c68189df1f9b4f9aacfa319381849697 and project d0f59694966848829048aee648dddccc. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:24:40.362622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:24:40.364908 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:24:40.416096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-23a2cc6c-3b0d-4377-9df2-82065bfa5f11 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564694 Jun 03 16:24:40.416749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 542/1058] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:24:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:24:40.426799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f3fdd43d-0311-440e-8e9d-4369cf061823 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:40.427443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f3fdd43d-0311-440e-8e9d-4369cf061823 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:40.480713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f3fdd43d-0311-440e-8e9d-4369cf061823 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:40.487984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f3fdd43d-0311-440e-8e9d-4369cf061823 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1238 microversion: 2.1 time: 0.065037 Jun 03 16:24:40.488569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 517/1059] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:40 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:41.164314 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:41.164805 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:41.171439 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:41.171892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:41.172658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:41.173090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:41.197934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:24:41.279194 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-69b91682-abc2-4d31-be9c-f4f4c62de6e1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 204 len: 0 microversion: 2.1 time: 0.118933 Jun 03 16:24:41.279923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 543/1060] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:24:41 2022] DELETE /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:24:41.288008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:41.288628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:41.295357 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:41.295820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:41.296791 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:41.297241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:41.505563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:41.506280 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:41.513259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:41.513673 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:41.514658 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:41.515228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:41.582462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:41.590372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-577c507d-3ae8-4171-96c7-486122f871d2 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1296 microversion: 2.1 time: 0.089756 Jun 03 16:24:41.590958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 544/1061] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:41 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:41.740625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:41.748494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3a32dfb2-699f-41af-a834-17a5cc8f4d1e tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1507 microversion: 2.1 time: 0.464413 Jun 03 16:24:41.749068 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 518/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:41 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1507 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:42.607386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:42.608013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:42.615460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:42.616002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:42.616920 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:42.617438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:42.765737 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:42.766786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:42.774259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:42.774854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:42.775768 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:42.776341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:42.992346 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:42.999801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5b84e4d5-37ad-4234-a74d-e174672f1c1f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.396407 Jun 03 16:24:43.000367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 545/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:42 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:43.024674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:43.032121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e6538969-2b49-41c6-bcc2-39d2eaa2e21d tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 200 len: 1507 microversion: 2.1 time: 0.270261 Jun 03 16:24:43.032695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 519/1064] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:42 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:24:43.211510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-6b383b02-5b7f-46c5-96a8-1f26afd949cf req-7b0e7b9d-80f2-499e-a043-7c40019ff9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c90b829-8496-4298-b54d-fd9a976bbae3", "name": "network-vif-deleted", "tag": "b13a12b7-9968-49f9-a695-b305c53c2ff7"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:43.221896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-6b383b02-5b7f-46c5-96a8-1f26afd949cf req-7b0e7b9d-80f2-499e-a043-7c40019ff9db service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:43.222856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-6b383b02-5b7f-46c5-96a8-1f26afd949cf req-7b0e7b9d-80f2-499e-a043-7c40019ff9db service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:43.257541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-6b383b02-5b7f-46c5-96a8-1f26afd949cf req-7b0e7b9d-80f2-499e-a043-7c40019ff9db service nova] Creating event network-vif-deleted:b13a12b7-9968-49f9-a695-b305c53c2ff7 for instance 4c90b829-8496-4298-b54d-fd9a976bbae3 on hv-cinder-83699 Jun 03 16:24:43.273255 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-6b383b02-5b7f-46c5-96a8-1f26afd949cf req-7b0e7b9d-80f2-499e-a043-7c40019ff9db service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065871 Jun 03 16:24:43.274348 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 546/1065] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:44.016863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:44.018299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:44.024809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.025278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.026037 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.026497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.050687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:44.052045 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4c90b829-8496-4298-b54d-fd9a976bbae3] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:44.059612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.060095 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.060888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.061336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.075236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] HTTP exception thrown: Instance 4c90b829-8496-4298-b54d-fd9a976bbae3 could not be found. Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Request method failure captured: Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 HTTP/1.1 Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO8CvWPyoGUGP7589mDfybb0r4x4SIfyl7oWrTkzfwNMVxJ7YY4L7okSJ02orQcqE8viW_VKf4NFF1cBpsNksHfWkEQkayTtL_IkXahuioGHODuDL3RAH7U6m7Q3fq_LgXhmBUPe5Yfc6LwvahIygeKT0ma-hZUV8Mpyy_dVOHpRiA Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:24:44.076932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1443b802dc724950b5eb5c6446e2515c"}]}] Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 4206a21c317e4b5aace8541699f8032d Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 4c90b829-8496-4298-b54d-fd9a976bbae3 could not be found. Jun 03 16:24:44.078554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '4c90b829-8496-4298-b54d-fd9a976bbae3'} Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c90b829-8496-4298-b54d-fd9a976bbae3 could not be found. Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:24:44.079588 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c90b829-8496-4298-b54d-fd9a976bbae3 could not be found. Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c90b829-8496-4298-b54d-fd9a976bbae3 could not be found. Jun 03 16:24:44.080941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:44.082010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Returning 404 to user: Instance 4c90b829-8496-4298-b54d-fd9a976bbae3 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:24:44.082010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-02d66255-af82-4e16-a65a-ee0f09ce89b1 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3" status: 404 len: 111 microversion: 2.1 time: 0.032354 Jun 03 16:24:44.082010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 547/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:44 2022] GET /compute/v2.1/servers/4c90b829-8496-4298-b54d-fd9a976bbae3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 16:24:44.087581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:44.088080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:44.094716 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.095176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.096034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.096530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.124176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:24:44.164096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:44.172142 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-da7a98bf-c813-4e70-b3c7-8ff7ddf7a860 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.159209 Jun 03 16:24:44.172720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 520/1067] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:44 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:44.199902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f9c432cb-25e8-4a51-8a6d-b3ce19be9af4 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 204 len: 0 microversion: 2.1 time: 0.115716 Jun 03 16:24:44.200510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 548/1068] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:24:44 2022] DELETE /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:24:44.208318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:44.208939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:44.214869 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.215378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.216135 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:44.216582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:44.348018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:44.355901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-89c463e9-6f9c-4ed8-8170-36e3e51e5d24 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.151408 Jun 03 16:24:44.356460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 521/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:44 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:45.190061 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:45.190788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:45.197832 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:45.198277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:45.199042 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:45.199511 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:45.288849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-0a616c3d-5af2-4e49-ac7e-8d113686b05d req-9e44a620-70cf-423b-8acf-d3acb65e2cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c8a0f7-905d-42bd-ae2b-fd92576529fb", "tag": "41e725ed-2822-4f59-a76d-137da0e19a16"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:45.297552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-0a616c3d-5af2-4e49-ac7e-8d113686b05d req-9e44a620-70cf-423b-8acf-d3acb65e2cf2 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:45.297999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-0a616c3d-5af2-4e49-ac7e-8d113686b05d req-9e44a620-70cf-423b-8acf-d3acb65e2cf2 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:45.310883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-0a616c3d-5af2-4e49-ac7e-8d113686b05d req-9e44a620-70cf-423b-8acf-d3acb65e2cf2 service nova] Creating event network-changed:41e725ed-2822-4f59-a76d-137da0e19a16 for instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb on hv-cinder-83699 Jun 03 16:24:45.316008 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-0a616c3d-5af2-4e49-ac7e-8d113686b05d req-9e44a620-70cf-423b-8acf-d3acb65e2cf2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030799 Jun 03 16:24:45.316598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 522/1070] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:45.327000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:45.334431 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8b3e1956-6245-4119-ac25-0e3fe756519d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.148627 Jun 03 16:24:45.334984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 549/1071] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:45 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:45.373751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:45.374455 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:45.381336 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:45.381785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:45.382550 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:45.382992 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:45.509284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:45.516762 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4f64cc0f-ca11-42ad-b1e9-39bcc06f501f tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.147179 Jun 03 16:24:45.517586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 523/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:45 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:46.351465 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:46.352080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:46.358946 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:46.359435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:46.360197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:46.360635 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:46.498627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:46.505989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d2ed0cab-340e-4f58-b13d-d7e1f6e7e8bd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.158889 Jun 03 16:24:46.506486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 550/1073] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:46 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:46.534377 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:46.535002 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:46.541986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:46.542445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:46.543216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:46.543681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:46.671247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:46.678776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a37cd991-fe7e-4ca4-afc0-87491cdcd3da tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.148342 Jun 03 16:24:46.679361 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 524/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:46 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:47.522841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:47.523452 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:47.529989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:47.530443 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:47.531214 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:47.531684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:47.660524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:47.667926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6f6c03b7-27fd-4bc9-89f3-72c68e1c866c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.148971 Jun 03 16:24:47.668794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 551/1075] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:47 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:47.696373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:47.696989 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:47.703223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:47.703705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:47.704491 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:47.704933 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:47.909721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4206a21c317e4b5aace8541699f8032d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443b802dc724950b5eb5c6446e2515c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:47.917894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-85d9e877-4f27-4e61-b0b2-94fc0a8e0c00 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 200 len: 1522 microversion: 2.1 time: 0.225509 Jun 03 16:24:47.926902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 525/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:47 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:48.149380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-e1ae0f1e-70b4-4aa6-8010-14126c93a0c8 req-96fd4bfd-e9a0-49ed-afc4-8f683413f6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03", "name": "network-vif-deleted", "tag": "db97c3da-b633-48cb-8479-c740ca53cd00"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:48.157360 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-e1ae0f1e-70b4-4aa6-8010-14126c93a0c8 req-96fd4bfd-e9a0-49ed-afc4-8f683413f6ff service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:48.157795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-e1ae0f1e-70b4-4aa6-8010-14126c93a0c8 req-96fd4bfd-e9a0-49ed-afc4-8f683413f6ff service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:48.168803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-e1ae0f1e-70b4-4aa6-8010-14126c93a0c8 req-96fd4bfd-e9a0-49ed-afc4-8f683413f6ff service nova] Creating event network-vif-deleted:db97c3da-b633-48cb-8479-c740ca53cd00 for instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 on hv-cinder-83699 Jun 03 16:24:48.173777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-e1ae0f1e-70b4-4aa6-8010-14126c93a0c8 req-96fd4bfd-e9a0-49ed-afc4-8f683413f6ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028593 Jun 03 16:24:48.174349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 552/1077] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:48.684849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:48.686021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:48.692149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:48.692605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:48.693371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:48.693811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:48.825538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:48.832921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2b5e5f13-4ffe-459c-9bd1-1b39cab9a92b tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.151987 Jun 03 16:24:48.833480 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 526/1078] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:48 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:48.934791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:48.935518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] [instance: 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:48.941679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:48.942133 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:48.942897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:48.943393 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:48.956485 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] HTTP exception thrown: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 could not be found. Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Request method failure captured: Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 HTTP/1.1 Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO8CvWPyoGUGP7589mDfybb0r4x4SIfyl7oWrTkzfwNMVxJ7YY4L7okSJ02orQcqE8viW_VKf4NFF1cBpsNksHfWkEQkayTtL_IkXahuioGHODuDL3RAH7U6m7Q3fq_LgXhmBUPe5Yfc6LwvahIygeKT0ma-hZUV8Mpyy_dVOHpRiA Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:24:48.958608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/1443b802dc724950b5eb5c6446e2515c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_1443b802dc724950b5eb5c6446e2515c"}]}] Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 1443b802dc724950b5eb5c6446e2515c Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362576974 Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 4206a21c317e4b5aace8541699f8032d Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362576974-project Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 could not be found. Jun 03 16:24:48.960230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03'} Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 could not be found. Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:24:48.961107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 could not be found. Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 could not be found. Jun 03 16:24:48.962320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:24:48.963446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] Returning 404 to user: Instance 4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:24:48.963446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-814561c6-bab4-46f4-acd3-2415dbcf6cd3 tempest-ServerRescueNegativeTestJSON-1362576974 tempest-ServerRescueNegativeTestJSON-1362576974-project] 10.222.0.41 "GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03" status: 404 len: 111 microversion: 2.1 time: 0.029854 Jun 03 16:24:48.963446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 553/1079] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:48 2022] GET /compute/v2.1/servers/4a9cc4fb-88d6-4bc5-a3db-c8ab23824e03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:24:49.850974 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:49.852449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:49.859472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:49.860258 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:49.861247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:49.862050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:49.970359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-9581339a-9cbd-474e-99f0-77a0c37200ad req-d278797b-491d-4e7d-9187-fd357eb1e4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8a0f7-905d-42bd-ae2b-fd92576529fb", "name": "network-vif-plugged", "status": "completed", "tag": "41e725ed-2822-4f59-a76d-137da0e19a16"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:49.983869 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-9581339a-9cbd-474e-99f0-77a0c37200ad req-d278797b-491d-4e7d-9187-fd357eb1e4c8 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:49.984765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-9581339a-9cbd-474e-99f0-77a0c37200ad req-d278797b-491d-4e7d-9187-fd357eb1e4c8 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:49.998797 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-9581339a-9cbd-474e-99f0-77a0c37200ad req-d278797b-491d-4e7d-9187-fd357eb1e4c8 service nova] Creating event network-vif-plugged:41e725ed-2822-4f59-a76d-137da0e19a16 for instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb on hv-cinder-83699 Jun 03 16:24:50.000175 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:50.004254 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-9581339a-9cbd-474e-99f0-77a0c37200ad req-d278797b-491d-4e7d-9187-fd357eb1e4c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037903 Jun 03 16:24:50.005545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 554/1080] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:50.010283 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-39897ee0-99bb-461f-bc85-44bbc46b9d05 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.163967 Jun 03 16:24:50.011475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 527/1081] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:49 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:51.025900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:51.026671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=6 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:51.031175 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:51.031921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:51.035233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:51.040140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:51.040781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:51.041752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:51.042962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:51.583085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:51.591860 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cafb2bfb-e083-47fd-841c-ff24a38bee7e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1364 microversion: 2.1 time: 0.566809 Jun 03 16:24:51.592642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 555/1082] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:51 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:52.609413 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:52.609942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:52.611936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=6 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:24:52.617845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:52.618297 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:52.619071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:52.619538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:52.775182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:24:52.782928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-260b3487-cfe4-453c-a376-5fa6ef2e6ff3 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1549 microversion: 2.1 time: 0.177522 Jun 03 16:24:52.783716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 528/1083] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:24:52 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:24:52.799100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:52.799684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:24:52.807970 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:52.808493 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:52.810120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:52.811525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:52.892939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c3548578-92aa-4190-a03e-468f89afd0aa tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097702 Jun 03 16:24:52.893641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 556/1084] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:24:52 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:53.669496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-19121543-28f6-4c2e-8cb9-825b5920f581 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Action: 'create', calling method: .version_select at 0x7fb5c0a7d9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1498093053"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:53.970650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-19121543-28f6-4c2e-8cb9-825b5920f581 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.419906 Jun 03 16:24:53.971460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 529/1085] 10.222.0.41 () {60 vars in 1154 bytes} [Fri Jun 3 16:24:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 16:24:53.984180 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9232bab7-6a70-485f-b7f5-d0fa1ee05552 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5de2dc0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:54.042385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9232bab7-6a70-485f-b7f5-d0fa1ee05552 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 200 len: 345 microversion: 2.1 time: 0.063086 Jun 03 16:24:54.043341 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 557/1086] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:24:53 2022] GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:54.501308 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-9899b0ab-7e66-4dc6-b6f5-dca4fe47c92c req-4e0393dd-e61b-406a-b280-f7f3c4b8678d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c8a0f7-905d-42bd-ae2b-fd92576529fb", "tag": "41e725ed-2822-4f59-a76d-137da0e19a16"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:54.510849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-9899b0ab-7e66-4dc6-b6f5-dca4fe47c92c req-4e0393dd-e61b-406a-b280-f7f3c4b8678d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:24:54.511448 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-9899b0ab-7e66-4dc6-b6f5-dca4fe47c92c req-4e0393dd-e61b-406a-b280-f7f3c4b8678d service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:24:54.524219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-9899b0ab-7e66-4dc6-b6f5-dca4fe47c92c req-4e0393dd-e61b-406a-b280-f7f3c4b8678d service nova] Creating event network-changed:41e725ed-2822-4f59-a76d-137da0e19a16 for instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb on hv-cinder-83699 Jun 03 16:24:54.529040 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-9899b0ab-7e66-4dc6-b6f5-dca4fe47c92c req-4e0393dd-e61b-406a-b280-f7f3c4b8678d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031576 Jun 03 16:24:54.529647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 530/1087] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:55.065808 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7869aa00-e738-484d-b794-35c5bf0378b5 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5e029d0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:55.114817 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7869aa00-e738-484d-b794-35c5bf0378b5 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 200 len: 346 microversion: 2.1 time: 0.063418 Jun 03 16:24:55.115661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 558/1088] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:24:55 2022] GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:55.127760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-729d0333-8637-4503-ac3e-5de7385b630d tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Action: 'create', calling method: .version_select at 0x7fb5c0c211f0>, body: {"snapshot": {"volume_id": "052120eb-d08e-468e-9252-9e2bbf515b39", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-931885631"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:24:55.285911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-729d0333-8637-4503-ac3e-5de7385b630d tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.162033 Jun 03 16:24:55.286524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 531/1089] 10.222.0.41 () {60 vars in 1161 bytes} [Fri Jun 3 16:24:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:55.296301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c6091e2a-28a5-4236-846b-1da3cf0b6ebd tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5e0fdc0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:55.330583 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c6091e2a-28a5-4236-846b-1da3cf0b6ebd tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.038086 Jun 03 16:24:55.331229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 559/1090] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:24:55 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:24:55.341699 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-597e20ba-b5c0-49af-a897-c99b17e28cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c1893790>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:55.388173 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-597e20ba-b5c0-49af-a897-c99b17e28cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.050444 Jun 03 16:24:55.388743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 532/1091] 10.222.0.41 () {58 vars in 1139 bytes} [Fri Jun 3 16:24:55 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:55.400082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f325cd75-27e9-45d0-a087-4a029a3f2440 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5e0ff70>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:55.430047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f325cd75-27e9-45d0-a087-4a029a3f2440 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.034024 Jun 03 16:24:55.430617 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 560/1092] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:24:55 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:56.442245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b9ec0c9d-08a4-47be-9e42-9d4a80bb8c98 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0d484c0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:56.471936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b9ec0c9d-08a4-47be-9e42-9d4a80bb8c98 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.034002 Jun 03 16:24:56.472579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 533/1093] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:24:56 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:57.484334 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5424d105-8dfb-4c65-addc-fcc0d03bdbd8 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5e44430>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:57.514240 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5424d105-8dfb-4c65-addc-fcc0d03bdbd8 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.034283 Jun 03 16:24:57.514830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 561/1094] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:24:57 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:58.526994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d346105c-724f-4ef0-8567-9b4c8ae1ad5e tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0c785e0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:58.555257 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d346105c-724f-4ef0-8567-9b4c8ae1ad5e tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.032626 Jun 03 16:24:58.555844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 534/1095] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:24:58 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:24:59.567125 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8c4aa0f7-217c-4cf0-bbbb-b4d7aaf1947e tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5d5c5e0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:24:59.595852 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8c4aa0f7-217c-4cf0-bbbb-b4d7aaf1947e tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.033760 Jun 03 16:24:59.596422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 562/1096] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:24:59 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:00.607745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d62244d5-114f-4437-8420-0fad1f8aaed7 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0cb8790>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:00.637424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d62244d5-114f-4437-8420-0fad1f8aaed7 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 287 microversion: 2.1 time: 0.034002 Jun 03 16:25:00.637996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 535/1097] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:25:00 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:00.648685 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9301bdd5-2bad-404c-8129-7bd10f507d20 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5de2310>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:00.705163 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9301bdd5-2bad-404c-8129-7bd10f507d20 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 202 len: 0 microversion: 2.1 time: 0.060761 Jun 03 16:25:00.705735 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 563/1098] 10.222.0.41 () {58 vars in 1253 bytes} [Fri Jun 3 16:25:00 2022] DELETE /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:25:00.714209 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-74c8b357-57f0-48e7-af34-9085a7efac1b tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0d38160>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:00.744234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-74c8b357-57f0-48e7-af34-9085a7efac1b tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 200 len: 286 microversion: 2.1 time: 0.033759 Jun 03 16:25:00.744800 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 536/1099] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:25:00 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:01.757378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-201d1060-a059-46b6-988e-894169c09cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5d5c940>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:01.781375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-201d1060-a059-46b6-988e-894169c09cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] HTTP exception thrown: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-201d1060-a059-46b6-988e-894169c09cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Request method failure captured: Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb HTTP/1.1 Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjXVkZ6libA9uuElz2n1R1e7oNojO1MtExu8-0OO6L4BgZfneu4wGMbpEYjeneGOtb4h-4DGTyiAxSs-xPsK1ecURbbt95ol_sBVo1BtEJZNUTWfAG-pDrdvx_ERoxux5922zLrE_pWxRLMLTMuQG2gq4ER56JM0zSIINBHdwfDll5g Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:25:01.784939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e7fcd0ea340b433b9a2fc0907aedf434"}]}] Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: aa76db5fc063438f865cb2e2909c8353 Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '56b10678-6366-49fc-a64e-ab5bf35220cb'} Jun 03 16:25:01.786361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. (HTTP 404) (Request-ID: req-bc2bf35c-8581-48fa-9057-eb40c3cf98ac) Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.787247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:25:01.788798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 16:25:01.790320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-201d1060-a059-46b6-988e-894169c09cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Returning 404 to user: Snapshot 56b10678-6366-49fc-a64e-ab5bf35220cb could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:25:01.791913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-201d1060-a059-46b6-988e-894169c09cc4 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb" status: 404 len: 111 microversion: 2.1 time: 0.034204 Jun 03 16:25:01.792906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 564/1100] 10.222.0.41 () {58 vars in 1250 bytes} [Fri Jun 3 16:25:01 2022] GET /compute/v2.1/os-snapshots/56b10678-6366-49fc-a64e-ab5bf35220cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:25:01.798345 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1dee6f99-cfa8-4344-bccb-6f869428f326 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0c78670>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:01.856582 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1dee6f99-cfa8-4344-bccb-6f869428f326 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 202 len: 0 microversion: 2.1 time: 0.062267 Jun 03 16:25:01.857181 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 537/1101] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:25:01 2022] DELETE /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:25:01.865641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-29427d55-a55f-4149-b0f1-a0d04134b05d tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5d5cdc0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:01.911188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-29427d55-a55f-4149-b0f1-a0d04134b05d tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 200 len: 345 microversion: 2.1 time: 0.049704 Jun 03 16:25:01.911789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 565/1102] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:25:01 2022] GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:02.924410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d63ee513-3ba4-4b2a-b50a-8601de6bb702 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0d480d0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:02.951188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-d63ee513-3ba4-4b2a-b50a-8601de6bb702 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] HTTP exception thrown: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d63ee513-3ba4-4b2a-b50a-8601de6bb702 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Request method failure captured: Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 HTTP/1.1 Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjXVkZ6libA9uuElz2n1R1e7oNojO1MtExu8-0OO6L4BgZfneu4wGMbpEYjeneGOtb4h-4DGTyiAxSs-xPsK1ecURbbt95ol_sBVo1BtEJZNUTWfAG-pDrdvx_ERoxux5922zLrE_pWxRLMLTMuQG2gq4ER56JM0zSIINBHdwfDll5g Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:25:02.954608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e7fcd0ea340b433b9a2fc0907aedf434"}]}] Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: aa76db5fc063438f865cb2e2909c8353 Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '052120eb-d08e-468e-9252-9e2bbf515b39'} Jun 03 16:25:02.956215 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. (HTTP 404) (Request-ID: req-1f7999a9-580b-481a-9074-2467b1565181) Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:02.957164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:25:02.959157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 16:25:02.961341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d63ee513-3ba4-4b2a-b50a-8601de6bb702 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Returning 404 to user: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d63ee513-3ba4-4b2a-b50a-8601de6bb702 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 404 len: 109 microversion: 2.1 time: 0.036007 Jun 03 16:25:02.962831 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 538/1103] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:25:02 2022] GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:25:02.965761 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:02.966573 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:02.970554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-af9f684f-b3d0-4236-ae0a-cf0ce6a09605 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c5d1cd30>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:02.998461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-af9f684f-b3d0-4236-ae0a-cf0ce6a09605 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] HTTP exception thrown: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-af9f684f-b3d0-4236-ae0a-cf0ce6a09605 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Request method failure captured: Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 HTTP/1.1 Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjXVkZ6libA9uuElz2n1R1e7oNojO1MtExu8-0OO6L4BgZfneu4wGMbpEYjeneGOtb4h-4DGTyiAxSs-xPsK1ecURbbt95ol_sBVo1BtEJZNUTWfAG-pDrdvx_ERoxux5922zLrE_pWxRLMLTMuQG2gq4ER56JM0zSIINBHdwfDll5g Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:25:03.000772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e7fcd0ea340b433b9a2fc0907aedf434"}]}] Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: aa76db5fc063438f865cb2e2909c8353 Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '052120eb-d08e-468e-9252-9e2bbf515b39'} Jun 03 16:25:03.002337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. (HTTP 404) (Request-ID: req-b6448e32-ac45-4b9a-943f-741141d91074) Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:03.003287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 16:25:03.004724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 16:25:03.006507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-af9f684f-b3d0-4236-ae0a-cf0ce6a09605 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Returning 404 to user: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-af9f684f-b3d0-4236-ae0a-cf0ce6a09605 tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 404 len: 109 microversion: 2.1 time: 0.038120 Jun 03 16:25:03.007897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 566/1104] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:25:02 2022] DELETE /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:25:03.011705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d7b692cd-eb08-482a-98fb-adb621a75c1c tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Calling method '.version_select at 0x7fb5c0d480d0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:03.038957 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-d7b692cd-eb08-482a-98fb-adb621a75c1c tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] HTTP exception thrown: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d7b692cd-eb08-482a-98fb-adb621a75c1c tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Request method failure captured: Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 HTTP/1.1 Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjXVkZ6libA9uuElz2n1R1e7oNojO1MtExu8-0OO6L4BgZfneu4wGMbpEYjeneGOtb4h-4DGTyiAxSs-xPsK1ecURbbt95ol_sBVo1BtEJZNUTWfAG-pDrdvx_ERoxux5922zLrE_pWxRLMLTMuQG2gq4ER56JM0zSIINBHdwfDll5g Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:25:03.041631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e7fcd0ea340b433b9a2fc0907aedf434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e7fcd0ea340b433b9a2fc0907aedf434"}]}] Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: e7fcd0ea340b433b9a2fc0907aedf434 Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-132274739 Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: aa76db5fc063438f865cb2e2909c8353 Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-132274739-project Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '052120eb-d08e-468e-9252-9e2bbf515b39'} Jun 03 16:25:03.043171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. (HTTP 404) (Request-ID: req-324bc579-2305-4fce-8b97-60a9c1748c7d) Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:03.044346 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:25:03.045705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 16:25:03.047116 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d7b692cd-eb08-482a-98fb-adb621a75c1c tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] Returning 404 to user: Volume 052120eb-d08e-468e-9252-9e2bbf515b39 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d7b692cd-eb08-482a-98fb-adb621a75c1c tempest-VolumesSnapshotsTestJSON-132274739 tempest-VolumesSnapshotsTestJSON-132274739-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39" status: 404 len: 109 microversion: 2.1 time: 0.035168 Jun 03 16:25:03.048500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 539/1105] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:25:03 2022] GET /compute/v2.1/os-volumes/052120eb-d08e-468e-9252-9e2bbf515b39 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:25:05.687155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7c2caaa6-ee94-4037-a703-7ed0944b6c53 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c5ca8310>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:05.734144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7c2caaa6-ee94-4037-a703-7ed0944b6c53 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/9a36a7e4-c45e-41ef-9cd1-f2aed9905b65" status: 200 len: 350 microversion: 2.1 time: 0.051190 Jun 03 16:25:05.734710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 567/1106] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:25:05 2022] GET /compute/v2.1/os-volumes/9a36a7e4-c45e-41ef-9cd1-f2aed9905b65 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:07.045033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:07.045922 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=82 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:07.050858 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-83391986-1117-4f66-8176-6b6bfc36d587 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c17ae430>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:07.101102 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-83391986-1117-4f66-8176-6b6bfc36d587 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0359c3ab-fd72-408b-b73b-dfe1d7092485" status: 200 len: 351 microversion: 2.1 time: 0.057618 Jun 03 16:25:07.101668 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 540/1107] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:25:07 2022] GET /compute/v2.1/os-volumes/0359c3ab-fd72-408b-b73b-dfe1d7092485 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:08.414259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-48902452-e4ae-4e21-a914-6651c4064388 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c5ca8ee0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:08.459373 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-48902452-e4ae-4e21-a914-6651c4064388 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b8a2f575-676c-49ab-95ba-6fdfde90da86" status: 200 len: 350 microversion: 2.1 time: 0.049379 Jun 03 16:25:08.459948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 568/1108] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes/b8a2f575-676c-49ab-95ba-6fdfde90da86 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:08.471223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-26233300-15fd-41d7-84b0-9963cb8bf8a3 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c0cd28b0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:08.549581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-26233300-15fd-41d7-84b0-9963cb8bf8a3 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082443 Jun 03 16:25:08.550148 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 541/1109] 10.222.0.41 () {58 vars in 1133 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:25:08.561899 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-80989284-0256-40ef-9f20-c149f1b3e068 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c5ca8280>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:08.640369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-80989284-0256-40ef-9f20-c149f1b3e068 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082113 Jun 03 16:25:08.640965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 569/1110] 10.222.0.41 () {58 vars in 1148 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:08.653274 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-607146f4-072e-4e13-acc7-b7a2775605c4 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c0d17430>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:08.731819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-607146f4-072e-4e13-acc7-b7a2775605c4 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082114 Jun 03 16:25:08.732375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 542/1111] 10.222.0.41 () {58 vars in 1133 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:08.743195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-22080217-f1a9-41ce-823f-04a00005cd18 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c5d1cca0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:08.821292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-22080217-f1a9-41ce-823f-04a00005cd18 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081781 Jun 03 16:25:08.821841 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 570/1112] 10.222.0.41 () {58 vars in 1166 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:08.832981 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9da6f0b0-ee43-4e00-a523-8e3cf8f7b318 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c0a43040>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:08.913219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9da6f0b0-ee43-4e00-a523-8e3cf8f7b318 tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083845 Jun 03 16:25:08.913788 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 543/1113] 10.222.0.41 () {58 vars in 1169 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:08.925334 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c02683a8-c3cb-4ad3-975a-61c9841f1dbb tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c5cac550>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:09.008886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c02683a8-c3cb-4ad3-975a-61c9841f1dbb tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086996 Jun 03 16:25:09.009395 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 571/1114] 10.222.0.41 () {58 vars in 1154 bytes} [Fri Jun 3 16:25:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:09.020418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-46d402a9-da53-4bdf-9792-d8d126350bbb tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c0a8fc10>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:09.098291 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-46d402a9-da53-4bdf-9792-d8d126350bbb tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081772 Jun 03 16:25:09.098857 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 544/1115] 10.222.0.41 () {58 vars in 1187 bytes} [Fri Jun 3 16:25:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:09.110701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-1355be87-87d3-4a35-a791-e9c2eb69bdbe tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] Calling method '.version_select at 0x7fb5c5ca83a0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:09.194203 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-1355be87-87d3-4a35-a791-e9c2eb69bdbe tempest-VolumesTestJSON-1739634060 tempest-VolumesTestJSON-1739634060-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087572 Jun 03 16:25:09.194757 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 572/1116] 10.222.0.41 () {58 vars in 1154 bytes} [Fri Jun 3 16:25:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:30.011226 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:30.011869 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:30.018119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:30.018566 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:30.019609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:30.020045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:30.042760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-024680ef-9c40-4642-8be1-ff0933d17694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/ips" status: 200 len: 150 microversion: 2.1 time: 0.036088 Jun 03 16:25:30.043321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 545/1117] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:25:30 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:31.349271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd5174f-17e1-43f3-9862-f06bbfb52992"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:25:31.350334 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:31.356955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:31.357422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:31.358207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:31.358656 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:31.592344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5536255b-ffff-4920-9bf6-a536fdbc7c1d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247581 Jun 03 16:25:31.592997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 573/1118] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:25:31 2022] POST /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:42.228860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd5174f-17e1-43f3-9862-f06bbfb52992"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:25:42.230506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:42.233033 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:42.233701 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=4 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:42.239224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:42.239716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:42.240478 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:42.240917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:42.318770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Invalid volume: volume bbd5174f-17e1-43f3-9862-f06bbfb52992 is already attached to instances: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: POST /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments HTTP/1.1 Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 74 Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:25:42.320410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {"volumeAttachment": {"volumeId": "bbd5174f-17e1-43f3-9862-f06bbfb52992"}} Jun 03 16:25:42.322034 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Invalid volume: volume bbd5174f-17e1-43f3-9862-f06bbfb52992 is already attached to instances: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'server_id': 'cc4c2c92-9f7a-4f64-ba0e-afc94658a59e', 'body': {'volumeAttachment': {'volumeId': 'bbd5174f-17e1-43f3-9862-f06bbfb52992'}}} Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bbd5174f-17e1-43f3-9862-f06bbfb52992 is already attached to instances: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:42.322979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bbd5174f-17e1-43f3-9862-f06bbfb52992 is already attached to instances: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:25:42.324523 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bbd5174f-17e1-43f3-9862-f06bbfb52992 is already attached to instances: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 400 to user: Invalid volume: volume bbd5174f-17e1-43f3-9862-f06bbfb52992 is already attached to instances: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-838189e3-2ced-4e51-ab2a-c755790e0188 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097602 Jun 03 16:25:42.325973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 546/1119] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:25:42 2022] POST /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:25:42.378990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:42.379729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:42.384436 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:42.385025 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:42.392508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:42.392970 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:42.393979 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:42.394439 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:42.472947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lazy-loading 'services' on Instance uuid cc4c2c92-9f7a-4f64-ba0e-afc94658a59e {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:25:42.543304 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fb4458ab-95a5-4f08-b8df-44fc9c80cf0d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments/bbd5174f-17e1-43f3-9862-f06bbfb52992" status: 202 len: 0 microversion: 2.1 time: 0.165590 Jun 03 16:25:42.543929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 574/1120] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:25:42 2022] DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments/bbd5174f-17e1-43f3-9862-f06bbfb52992 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:25:42.552225 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:42.553208 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:42.559957 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:42.560405 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:42.561171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:42.561624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:42.590657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d9850948-429d-4a8c-8e1f-6fd8d57c5a59 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Jun 03 16:25:42.591234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 547/1121] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:42 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:43.603076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:43.604106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:43.610353 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:43.610810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:43.611597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:43.612038 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:43.641039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f8319932-57e6-4759-a521-fd6bbc8fe911 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Jun 03 16:25:43.641598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 575/1122] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:43 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:43.741447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:43.742466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:43.748876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:43.749321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:43.750075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:43.750510 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:43.774776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-503cf716-52d4-42bf-ab40-eac413f413e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/ips" status: 200 len: 151 microversion: 2.20 time: 0.037262 Jun 03 16:25:43.775336 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 548/1123] 10.222.0.41 () {60 vars in 1288 bytes} [Fri Jun 3 16:25:43 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 16:25:44.652980 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:44.653934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:44.660392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:44.660839 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:44.661611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:44.662049 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:44.690759 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-570de426-2724-4186-8197-af940e5b4100 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Jun 03 16:25:44.691312 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 576/1124] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:44 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:45.702999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:45.703951 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:45.710402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:45.710845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:45.711627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:45.712058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:45.740771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d091a415-e2fa-43a6-a295-ffaf8611b9be tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Jun 03 16:25:45.741310 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 549/1125] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:45 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:46.752832 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:46.753778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:46.761037 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:46.761500 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:46.762279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:46.762756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:46.792040 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-69205909-2f48-4481-995a-fda096b4fe0e tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Jun 03 16:25:46.792633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 577/1126] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:46 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:47.803554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:47.805073 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:47.811533 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:47.811979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:47.812731 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:47.813161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:47.841483 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5b0ebb4d-c8f3-44fc-87d2-013ede3db80f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041886 Jun 03 16:25:47.842043 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 550/1127] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:47 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:25:48.728388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:25:48.728918 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:48.735321 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:48.735793 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:48.736562 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:48.737001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:48.759204 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lazy-loading 'flavor' on Instance uuid 919a4e88-3477-4458-8420-214f2caf16c5 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:25:48.853404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:48.854321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:48.861098 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:48.861551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:48.862306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:48.862743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:48.892449 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-47731325-2c26-4d48-9630-01e4f5485694 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Jun 03 16:25:48.893035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 551/1128] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:48 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:25:49.168692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-01da488f-2957-46d9-9009-0ccd2c492cce tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/action" status: 202 len: 0 microversion: 2.20 time: 0.444007 Jun 03 16:25:49.169312 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 578/1129] 10.222.0.41 () {62 vars in 1318 bytes} [Fri Jun 3 16:25:48 2022] POST /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 16:25:49.177315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:49.177929 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:49.183917 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:49.184372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:49.185150 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:49.185667 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:49.429224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:49.437153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:49.438674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:49.439867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c535ee20-75d3-45cb-8128-bf18d155580a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.266443 Jun 03 16:25:49.440429 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 552/1130] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:49 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:49.905739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:49.906747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:49.913059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:49.913513 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:49.914910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:49.915377 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:49.943424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9cacd66d-d135-4baf-8e03-d2d5a4848706 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Jun 03 16:25:49.943969 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 579/1131] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:49 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:50.459038 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:50.459696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:50.466184 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:50.466634 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:50.467465 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:50.467904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:50.592797 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:50.600599 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:50.602112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:50.603272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0251e43a-19db-4373-9f60-3b4893ef6bd2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.148115 Jun 03 16:25:50.603849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 553/1132] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:50 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:50.954760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:50.955713 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:50.962795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:50.963248 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:50.964078 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:50.964519 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:50.992729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3fea8a68-cdfa-48aa-835c-f773d5799ff2 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Jun 03 16:25:50.993278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 580/1133] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:50 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:51.753254 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:51.754652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:51.760901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:51.761351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:51.762154 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:51.762755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:51.893426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:51.902302 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:51.903863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:51.905185 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-381971f5-b533-4666-bd73-0f2f4925fe95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.286984 Jun 03 16:25:51.905774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 554/1134] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:51 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:52.136001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:52.137120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:52.143080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:52.143520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:52.144290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:52.144985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:52.174232 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6ccf9f9c-38c4-439c-811a-08af974ce3c6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174075 Jun 03 16:25:52.174779 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 581/1135] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:51 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:25:52.923759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:52.924372 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:52.930939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:52.931426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:52.932185 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:52.932618 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.057223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:53.065347 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:53.066895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:53.068089 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2fee13d3-4ac2-422e-93f7-371ba77d1edf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.148269 Jun 03 16:25:53.068652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 555/1136] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:52 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:53.185648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:53.186599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:53.193521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:53.194243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.195825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:53.196279 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.224301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a07c94da-77da-410d-988a-5d821ad589ed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042569 Jun 03 16:25:53.224847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 582/1137] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:25:53 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:25:53.281284 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:53.281777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:53.287660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:53.288107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.288891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:53.289360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.315711 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:25:53.391830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6dbb6a8e-9f7f-4d4f-b4e1-ff16c51f9d5f tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 204 len: 0 microversion: 2.1 time: 0.112993 Jun 03 16:25:53.392058 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 556/1138] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:25:53 2022] DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:25:53.401284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:53.401964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:53.410609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:53.411060 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.411882 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:53.412315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:53.549514 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:53.557528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6c3db277-8c4a-4d9d-8445-41bfcfd29662 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1682 microversion: 2.1 time: 0.161132 Jun 03 16:25:53.558258 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 583/1139] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:25:53 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:54.087852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:54.088486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:54.095510 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:54.096986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:54.097775 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:54.101804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:54.229695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:54.237828 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:54.239373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:54.240547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-265a539c-cc39-43b3-9bf5-13391929640d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.157613 Jun 03 16:25:54.241117 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 557/1140] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:54 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:54.575220 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:54.575865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:54.582558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:54.583003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:54.583792 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:54.584233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:54.708408 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:54.717338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-abeea620-9b16-4544-bd55-83a41c57b454 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1682 microversion: 2.1 time: 0.145997 Jun 03 16:25:54.717905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 584/1141] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:25:54 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:55.258423 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:55.259115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:55.265655 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:55.266101 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:55.267318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:55.267318 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:55.449265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:55.457245 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:55.458769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:55.459971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a8f960d5-f094-4989-8799-3a595f561574 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.205980 Jun 03 16:25:55.460576 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 558/1142] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:55 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:55.734865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:55.735520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:55.742641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:55.743123 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:55.743924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:55.744385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:55.871962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:55.879322 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bd4c1b7a-a797-4088-80c5-564d7017d904 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1682 microversion: 2.1 time: 0.148300 Jun 03 16:25:55.879881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 585/1143] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:25:55 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:56.478669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:56.479205 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:56.485600 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:56.486050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:56.487149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:56.487620 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:56.625742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:56.633853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:56.635732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:56.637494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fdb09a98-bc1f-4276-93e0-a76adac5f033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.163351 Jun 03 16:25:56.638315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 559/1144] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:56 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:56.896802 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:56.897422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:56.904530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:56.904985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:56.905756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:56.906195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:57.032692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:57.040128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4f091475-cfa9-447e-af5a-51b7405803f1 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1682 microversion: 2.1 time: 0.147490 Jun 03 16:25:57.040690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 586/1145] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:25:56 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:57.657807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:57.658402 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:57.665412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:57.665860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:57.666613 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:57.667050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:57.794880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:57.802678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:57.804216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:57.805941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d20c12cc-c6fe-4334-ae80-8e334316e0a8 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.152023 Jun 03 16:25:57.806494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 560/1146] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:57 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:58.057202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:58.057747 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:58.064229 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:58.064686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:58.065460 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:58.065907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:58.196029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:58.199748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:58.205124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c238aa87-8bd5-42cc-81f6-bde6de0a27cc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1682 microversion: 2.1 time: 0.151881 Jun 03 16:25:58.205699 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 587/1147] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:25:58 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:58.824115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:58.824730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:58.830760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:58.831214 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:58.832006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:58.832442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:58.837015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:25:58.961212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:58.970286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:58.971938 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:58.973394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-745e761c-71b3-45a0-9fad-dc472bd71128 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.153380 Jun 03 16:25:58.974333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 561/1148] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:58 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:25:59.224984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:59.226785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:25:59.235117 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:59.235694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:59.236786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:25:59.237034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:25:59.373334 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:25:59.380809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bb5098fb-9561-49fb-9a5c-b091dab3b3bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1682 microversion: 2.1 time: 0.159887 Jun 03 16:25:59.381375 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 588/1149] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:25:59 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:25:59.993685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:25:59.994241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:00.001053 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:00.001503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:00.002278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:00.002716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:00.333111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:00.342706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:00.346778 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:00.348511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-35451d46-81bc-4ca9-8cdf-e6427c603844 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.358019 Jun 03 16:26:00.349944 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 562/1150] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:25:59 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:00.371425 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-3fe55245-eaac-4a00-a12f-0c3cabc207cd req-3a3c5de9-2884-4848-9322-f924bf4b8bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4c2c92-9f7a-4f64-ba0e-afc94658a59e", "name": "network-vif-deleted", "tag": "3b6e2361-79f3-49b0-80a2-5cad14ec6e44"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:00.382326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-3fe55245-eaac-4a00-a12f-0c3cabc207cd req-3a3c5de9-2884-4848-9322-f924bf4b8bf9 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:00.385719 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-3fe55245-eaac-4a00-a12f-0c3cabc207cd req-3a3c5de9-2884-4848-9322-f924bf4b8bf9 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:00.398956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:00.399895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:00.400816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-3fe55245-eaac-4a00-a12f-0c3cabc207cd req-3a3c5de9-2884-4848-9322-f924bf4b8bf9 service nova] Creating event network-vif-deleted:3b6e2361-79f3-49b0-80a2-5cad14ec6e44 for instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e on hv-cinder-83699 Jun 03 16:26:00.406674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:00.406988 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-3fe55245-eaac-4a00-a12f-0c3cabc207cd req-3a3c5de9-2884-4848-9322-f924bf4b8bf9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Jun 03 16:26:00.407144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:00.407889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:00.408338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:00.408976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 589/1151] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:00.539513 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:00.556843 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4a2ea0eb-2c73-45f2-bdc0-b0b5464cc254 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 200 len: 1326 microversion: 2.1 time: 0.162387 Jun 03 16:26:00.566063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 563/1152] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:00 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:01.372595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:01.373225 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:01.380575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:01.381043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:01.381837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:01.382285 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:01.522090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:01.529997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:01.531557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:01.532713 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-227d27bf-fe0d-4c69-89e7-f5b67402efe2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.164509 Jun 03 16:26:01.533266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 590/1153] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:01 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:01.573439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:01.574063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:01.580563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:01.581017 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:01.581789 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:01.582233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:01.597108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e HTTP/1.1 Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:26:01.598825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:26:01.600556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'cc4c2c92-9f7a-4f64-ba0e-afc94658a59e'} Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:26:01.602006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:26:01.603567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:01.604901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:26:01.604901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ece8448e-988f-4f44-b98f-1c7d0be8c400 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 404 len: 111 microversion: 2.1 time: 0.030809 Jun 03 16:26:01.604901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 564/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:01 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:26:01.610102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9c5148d1-97a9-4ad5-b48a-d76d15f076c3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '.version_select at 0x7fb5c5d5c940>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:01.628524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9c5148d1-97a9-4ad5-b48a-d76d15f076c3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133031994" status: 202 len: 0 microversion: 2.1 time: 0.022239 Jun 03 16:26:01.629024 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 591/1155] 10.222.0.41 () {58 vars in 1220 bytes} [Fri Jun 3 16:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133031994 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:26:02.252264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0d5a11b2-de1d-405a-bd13-c21e0008a5f4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: .version_select at 0x7fb5c0a8f670>, body: {"keypair": {"name": "tempest-keypair-107189768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxt7tY3o9QQPoHmRUZH8tMoOfJrzssd/IpTsXyIeVkw6yAJEhQlAUJs9U8Xb2mWW5+maTIuMICRtLfa4MdLAdCTTeXU2fXYAZSSPOuqqgWp7aZ8yJXt/0fCKpBmbiMI2g=="}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:02.266690 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-0d5a11b2-de1d-405a-bd13-c21e0008a5f4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:26:02.270752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-0d5a11b2-de1d-405a-bd13-c21e0008a5f4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:26:02.293048 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0d5a11b2-de1d-405a-bd13-c21e0008a5f4 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044641 Jun 03 16:26:02.293621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 565/1156] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:26:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:02.552419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:02.553172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:02.560469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:02.560940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:02.561762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:02.562217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:02.696750 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:02.705424 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:02.706933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:02.708121 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-82b940f1-4075-4ac4-be7b-0e6cd5390d78 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.160770 Jun 03 16:26:02.708852 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 592/1157] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:02 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:03.531815 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-981620695", "imageRef": "8c15e2e1-2704-4913-8d43-c590ed028bc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6fb749c5-3e3e-449b-80a2-fa7c692f9d8e"}], "security_groups": [{"name": "tempest-securitygroup--1248550579"}], "key_name": "tempest-keypair-107189768", "user_data": "}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:03.629512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.network.neutron [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] validate_networks() for [('6fb749c5-3e3e-449b-80a2-fa7c692f9d8e', None, None, None, None, None)] {{(pid=117570) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:26:03.726296 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:03.726907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:03.733486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:03.733933 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:03.734703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:03.735140 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:03.862718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:03.871565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:03.873318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:03.874675 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9c1cca3b-b1d2-4771-9909-5ef1d86adb41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.152405 Jun 03 16:26:03.875230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 593/1158] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:03 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:04.055283 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:26:04.055734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image limits 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:26:04.056256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Flavor pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:26:04.056788 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Image pref 0:0:0 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:26:04.057240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.virt.hardware [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:26:04.065990 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:04.066442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:04.067242 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:04.067713 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:04.084514 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:26:04.088460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Getting quotas for user ef7c1e449b864b50b3c71c39f19968a0 and project c6758d3ab63e4ace8d2d32a4b391d942. Resources: {'ram', 'cores', 'instances'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:26:04.099261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Going to run 1 instances... {{(pid=117570) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:26:04.101555 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c15e2e1-2704-4913-8d43-c590ed028bc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:26:04.148648 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6629c65c-7405-4421-b5e8-8012d68a2373 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621821 Jun 03 16:26:04.149551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 566/1159] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:26:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:26:04.159320 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dae30546-8259-4f47-a00b-6d632547f9e6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:04.159949 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dae30546-8259-4f47-a00b-6d632547f9e6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:04.212829 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dae30546-8259-4f47-a00b-6d632547f9e6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:04.219496 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dae30546-8259-4f47-a00b-6d632547f9e6 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1240 microversion: 2.1 time: 0.064022 Jun 03 16:26:04.220052 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 594/1160] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:04 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:04.893787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:04.894409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:04.901442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:04.901894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:04.902666 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:04.903109 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:05.032581 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:05.041883 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:05.043415 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:05.044569 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-80187375-ea7d-4fc2-a523-adf709e693a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.155232 Jun 03 16:26:05.045115 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 567/1161] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:04 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:05.237330 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:05.237974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:05.244625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:05.245094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:05.245883 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:05.246332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:05.323643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:05.331084 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-98b907fe-7102-43a3-b0c9-caed3b6bbd29 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1310 microversion: 2.1 time: 0.097969 Jun 03 16:26:05.331661 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 595/1162] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:05 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:06.064026 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:06.064647 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:06.071786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:06.072249 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:06.073030 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:06.073475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:06.297856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:06.306900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:06.308439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:06.309590 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-50e366c4-da61-420c-9387-53fac0c5e2ff tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.249475 Jun 03 16:26:06.310145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 568/1163] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:06 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:06.348274 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:06.349440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:06.355928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:06.356379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:06.357152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:06.357591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:06.493914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:06.503065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f5d2a6c2-c9b7-42c0-bc7e-32d278d9af14 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.158428 Jun 03 16:26:06.504288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 596/1164] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:06 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:06.660369 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-b22aeb88-c554-49c2-b4d9-5c62c3753d7f req-a630a35b-1aa8-4fe5-8fc1-4d39e2572497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cd9a4e-635f-422c-86f6-80e40d3f0f43", "tag": "88e3b07b-0347-4c81-a78d-450830d8f450"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:06.672895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-b22aeb88-c554-49c2-b4d9-5c62c3753d7f req-a630a35b-1aa8-4fe5-8fc1-4d39e2572497 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:06.673330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-b22aeb88-c554-49c2-b4d9-5c62c3753d7f req-a630a35b-1aa8-4fe5-8fc1-4d39e2572497 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:06.691870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-b22aeb88-c554-49c2-b4d9-5c62c3753d7f req-a630a35b-1aa8-4fe5-8fc1-4d39e2572497 service nova] Creating event network-changed:88e3b07b-0347-4c81-a78d-450830d8f450 for instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 on hv-cinder-83699 Jun 03 16:26:06.697558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-b22aeb88-c554-49c2-b4d9-5c62c3753d7f req-a630a35b-1aa8-4fe5-8fc1-4d39e2572497 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044008 Jun 03 16:26:06.698104 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 569/1165] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:07.328596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:07.329137 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:07.335358 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:07.336387 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:07.337166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:07.337627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:07.475676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:07.485580 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:07.487083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:07.488349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-93ec2bad-a37a-4abc-9e0e-c5af721a5eae tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.163784 Jun 03 16:26:07.488914 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 597/1166] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:07 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:07.521820 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:07.522522 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:07.528860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:07.529403 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:07.530169 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:07.530626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:07.661062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:07.669119 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c8a51d49-5072-487e-9ba0-cd16825cb1f3 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.152354 Jun 03 16:26:07.669678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 570/1167] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:07 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:08.257208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1688200514", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-540010629", "security_groups": [{"name": "tempest-secgroup-smoke-604653336"}], "block_device_mapping_v2": [{"uuid": "48c1f9c2-6b06-4c60-b3eb-2c342d39852e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6170e7ad-2948-49aa-8d76-bb5733efca78"}]}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:08.367894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] validate_networks() for [('6170e7ad-2948-49aa-8d76-bb5733efca78', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:26:08.509842 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:08.510715 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:08.517282 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:08.517812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:08.518662 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:08.519311 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:08.728524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:08.737722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:08.739408 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:08.740599 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-abad87bb-a249-4ec5-b0ee-22f702a54f52 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.234827 Jun 03 16:26:08.741858 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 571/1168] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:08 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:08.747066 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:08.747706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:08.753730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:08.754403 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:08.755370 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:08.755808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:08.778712 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:26:08.779263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:26:08.779757 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:26:08.780043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:26:08.780455 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:26:08.789502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:08.789948 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:08.790892 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:08.791342 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:08.808821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:26:08.812807 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Getting quotas for user 331c97a12f1b4c2eb1eefa61056ce089 and project 7d586c0c8dd34398af9d52425eb2bde3. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:26:08.878543 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:26:08.880677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48c1f9c2-6b06-4c60-b3eb-2c342d39852e',volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:26:08.921644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:08.931725 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-344ce084-d897-4ee9-91b6-b3e6de1df26b tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.188493 Jun 03 16:26:08.932299 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 572/1169] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:08 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:09.022288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5b624ffd-ccb5-4712-9ae1-30b7e1c90de2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769530 Jun 03 16:26:09.026696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 598/1170] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:26:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:26:09.034230 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b674e019-c8ab-47ea-803c-f9f68e31da5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:09.034958 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b674e019-c8ab-47ea-803c-f9f68e31da5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:09.098601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b674e019-c8ab-47ea-803c-f9f68e31da5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:09.106276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b674e019-c8ab-47ea-803c-f9f68e31da5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1094 microversion: 2.1 time: 0.076063 Jun 03 16:26:09.106862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 573/1171] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:09 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:09.759182 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:09.759816 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:09.765954 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:09.766404 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:09.767165 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:09.767626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:09.891935 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:09.900489 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:09.902026 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:09.903178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-59f0c2c8-9b88-44c9-9fee-734b7917d664 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.148412 Jun 03 16:26:09.903767 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 599/1172] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:09 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:09.948539 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:09.949148 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:09.956378 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:09.956825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:09.957578 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:09.958011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:10.081971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:10.089807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-646f8aff-21ce-4023-b7bf-2e48c0838c36 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.145013 Jun 03 16:26:10.090436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 574/1173] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:09 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:10.123880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:10.124506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:10.130468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:10.130927 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:10.131742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:10.132189 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:10.192408 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:10.199891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4548a9b4-001e-49d3-9af7-63c768a6e66f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1144 microversion: 2.1 time: 0.079887 Jun 03 16:26:10.200534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 600/1174] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:10 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:10.921676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:10.922303 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:10.928373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:10.928891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:10.929608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:10.930045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:11.101131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:11.106664 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:11.107410 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:11.109421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:11.111267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:11.112915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-818da799-f42e-4c8c-9029-ffc7c52180d3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1743 microversion: 2.20 time: 0.195475 Jun 03 16:26:11.113551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 575/1175] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:10 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:11.114633 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:11.115288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:11.116087 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:11.116522 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:11.217180 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:11.217904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:11.227939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:11.227939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:11.227939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:11.227939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:11.254468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:11.263286 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c1b71e87-3c13-4b5a-8916-ed89f9909fed tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.160341 Jun 03 16:26:11.264037 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 601/1176] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:11 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:11.314960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:11.324112 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-18a21a99-a3cb-41cf-bbd7-11811d0614fe tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1192 microversion: 2.1 time: 0.110857 Jun 03 16:26:11.324693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 576/1177] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:11 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:12.131593 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:12.132114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:12.140031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.140495 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.141749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.142382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.281912 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:12.282539 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:12.293865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:12.297047 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.297695 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.299154 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.300564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.304031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:12.312772 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:12.314419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:12.316093 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c267e27f-8f23-4ed0-8335-6831ee1103bf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1743 microversion: 2.20 time: 0.188392 Jun 03 16:26:12.317356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 602/1178] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:12 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:12.343328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:12.344294 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:12.350951 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.352281 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.353610 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.354530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.502029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:12.517510 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-362a12a2-2581-400d-b942-4e7f4921de86 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.179397 Jun 03 16:26:12.528155 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 603/1179] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:12 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:12.535433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-b3196ed7-ace8-4c21-b947-3020c2300905 req-ad0d0332-f0af-4317-884e-532f9eb025be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "name": "network-vif-plugged", "status": "completed", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:12.539337 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:12.547701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-b3196ed7-ace8-4c21-b947-3020c2300905 req-ad0d0332-f0af-4317-884e-532f9eb025be service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:12.548278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-b3196ed7-ace8-4c21-b947-3020c2300905 req-ad0d0332-f0af-4317-884e-532f9eb025be service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:12.552499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:12.564450 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-937ff0c4-3c24-43d4-b360-e823e3c694ea tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.287704 Jun 03 16:26:12.564980 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-b3196ed7-ace8-4c21-b947-3020c2300905 req-ad0d0332-f0af-4317-884e-532f9eb025be service nova] Creating event network-vif-plugged:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:26:12.574706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 577/1180] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:12 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:12.575414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-b3196ed7-ace8-4c21-b947-3020c2300905 req-ad0d0332-f0af-4317-884e-532f9eb025be service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041885 Jun 03 16:26:12.575414 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 604/1181] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:13.257261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-2a0441d5-985c-4a54-ae05-55e62c798461 req-9852d011-73ee-4f98-bf8d-f580954781a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256059e7-995a-4b7d-9439-f32447aca406", "tag": "81c8deba-9996-499e-b7d9-9e60b5cf128c"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:13.266641 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-2a0441d5-985c-4a54-ae05-55e62c798461 req-9852d011-73ee-4f98-bf8d-f580954781a8 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.267663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-2a0441d5-985c-4a54-ae05-55e62c798461 req-9852d011-73ee-4f98-bf8d-f580954781a8 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.280472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-2a0441d5-985c-4a54-ae05-55e62c798461 req-9852d011-73ee-4f98-bf8d-f580954781a8 service nova] Creating event network-changed:81c8deba-9996-499e-b7d9-9e60b5cf128c for instance 256059e7-995a-4b7d-9439-f32447aca406 on hv-cinder-83699 Jun 03 16:26:13.285789 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-2a0441d5-985c-4a54-ae05-55e62c798461 req-9852d011-73ee-4f98-bf8d-f580954781a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032397 Jun 03 16:26:13.287660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 578/1182] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:13.336110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:13.337670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:13.346176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.346786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.348018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.348647 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.499782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:13.507718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:13.509217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:13.510847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-997537c9-25c4-4f2d-bf3a-0252e0f023ef tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1743 microversion: 2.20 time: 0.179531 Jun 03 16:26:13.511429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 605/1183] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:13 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:13.542748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:13.543483 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:13.549760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.550208 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.550975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.551516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.581886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:13.582609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:13.589245 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.589778 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.590565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:13.591010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:13.718947 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:13.726517 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d884fb52-a58a-40d3-8873-397b3e0ea0fa tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.148455 Jun 03 16:26:13.727606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 606/1184] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:13 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:13.758848 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:13.767755 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1937762d-bb42-4b56-bc27-5387629ccd0b tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.230255 Jun 03 16:26:13.768335 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 579/1185] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:13 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:14.530456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:14.530992 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:14.537485 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:14.537932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:14.538698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:14.539170 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:14.668020 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:14.675900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:14.677405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:14.678556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9793125e-ba3c-444b-a88e-b14736d7c978 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1743 microversion: 2.20 time: 0.152098 Jun 03 16:26:14.679124 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 607/1186] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:14 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:14.744325 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:14.744941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:14.746897 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:14.752610 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:14.753062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:14.753824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:14.754261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:14.784959 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:14.785502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:14.792083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:14.792537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:14.793312 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:14.793751 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:14.812310 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=100 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:14.884108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:14.891649 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-efe89092-3a5d-462b-8f59-9ef2316c610c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.151677 Jun 03 16:26:14.892217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 580/1187] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:14 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:14.927627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:14.935815 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e095933a-9b98-46e5-9ca9-ab73bfab28ba tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.154677 Jun 03 16:26:14.936378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 608/1188] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:14 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:15.211264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-516c968b-1141-4812-8291-d573d006b836 req-26e9ace9-49f7-4919-8fcb-053c2abaf581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cd9a4e-635f-422c-86f6-80e40d3f0f43", "name": "network-vif-plugged", "status": "completed", "tag": "88e3b07b-0347-4c81-a78d-450830d8f450"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:15.219776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-516c968b-1141-4812-8291-d573d006b836 req-26e9ace9-49f7-4919-8fcb-053c2abaf581 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.220373 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-516c968b-1141-4812-8291-d573d006b836 req-26e9ace9-49f7-4919-8fcb-053c2abaf581 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:15.232337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-516c968b-1141-4812-8291-d573d006b836 req-26e9ace9-49f7-4919-8fcb-053c2abaf581 service nova] Creating event network-vif-plugged:88e3b07b-0347-4c81-a78d-450830d8f450 for instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 on hv-cinder-83699 Jun 03 16:26:15.237064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-516c968b-1141-4812-8291-d573d006b836 req-26e9ace9-49f7-4919-8fcb-053c2abaf581 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 Jun 03 16:26:15.237653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 581/1189] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:15.697541 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:15.698085 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:15.704626 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.705083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:15.705851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.706290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:15.845406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:15.853706 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:15.855266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:15.856605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-52e24d6b-933d-4f86-b2f4-a4ba20bb7247 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1743 microversion: 2.20 time: 0.163497 Jun 03 16:26:15.857384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 609/1190] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:15 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:15.909431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:15.910145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:15.916854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.917312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:15.918090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.918537 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:15.952533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:15.953064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:15.959323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.959821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:15.960621 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:15.961083 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:16.092074 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:16.099575 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-777020e7-abf7-477a-9be9-8d6e32ce2117 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.150895 Jun 03 16:26:16.100143 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 610/1191] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:15 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:16.202100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:16.209776 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9fb351d0-bee3-41c6-aaa3-1572226ad1bc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.305530 Jun 03 16:26:16.210277 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 582/1192] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:15 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:16.875854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:16.876463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:16.882814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:16.883263 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:16.884051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:16.884486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:17.010924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:17.019058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:17.020600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:17.021998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c57dca5d-3cd0-4177-bca1-cb00ab865f5b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1743 microversion: 2.20 time: 0.150100 Jun 03 16:26:17.022556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 611/1193] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:16 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:17.116446 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:17.117751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:17.124439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:17.124882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:17.125642 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:17.126071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:17.130151 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:17.225965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:17.227120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:17.232879 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:17.233333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:17.234106 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:17.234540 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:17.255164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:17.262741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0fd303e3-5df5-471c-a3c0-78f452811861 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.150392 Jun 03 16:26:17.263315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 583/1194] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:17 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:17.362929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:17.370205 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-55372b4a-71ae-4685-b1f0-adccfe8ab081 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1366 microversion: 2.1 time: 0.148191 Jun 03 16:26:17.370766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 612/1195] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:17 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:18.041162 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:18.041886 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:18.047816 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.048272 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.049036 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.049475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.203679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:18.213657 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:18.215152 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:18.216565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4886d24e-1812-48d8-a510-43c1347029d6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.179834 Jun 03 16:26:18.217605 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 584/1196] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:18 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:18.280359 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:18.281880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:18.295241 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.295857 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.296870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.297521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.388205 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:18.389109 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:18.397078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.398265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.399792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.400540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.460179 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:18.471724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-153463e7-b1d9-4ff1-9535-4b8327030579 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.195211 Jun 03 16:26:18.483338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 613/1197] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:18 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:18.570785 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:18.579733 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9ae55ce7-e4bb-4d6d-b5a2-02a366006814 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1557 microversion: 2.1 time: 0.197649 Jun 03 16:26:18.582394 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 585/1198] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:18 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1557 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:18.601739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:18.602264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:18.609327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.609770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.610752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:18.611176 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:18.689103 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a17a35e7-406c-4703-bb58-5cb9f9f8e0cb tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091499 Jun 03 16:26:18.689694 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 614/1199] 10.222.0.41 () {58 vars in 1274 bytes} [Fri Jun 3 16:26:18 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:19.235809 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:19.236603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:19.238617 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=12 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:19.245125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:19.245453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:19.248621 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:19.249269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:19.485659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:19.487237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=8 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:19.493029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:19.494025 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:19.512891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:19.513762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:19.515278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:19.515749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:19.565338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:19.581741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:19.583273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:19.584490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f380fa54-5836-45e6-9c0a-a674c7daac75 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.352814 Jun 03 16:26:19.590850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 586/1200] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:19 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:19.688559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:19.697921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-379970e2-d41c-440b-9c3f-d840ce95fb5f tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.212873 Jun 03 16:26:19.698797 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 615/1201] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:19 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:20.157247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-1bacd5cb-2a4b-4849-9085-003a67757766 req-24114d1f-c695-4473-ab65-353c39ca04ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cd9a4e-635f-422c-86f6-80e40d3f0f43", "tag": "88e3b07b-0347-4c81-a78d-450830d8f450"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:20.186198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-1bacd5cb-2a4b-4849-9085-003a67757766 req-24114d1f-c695-4473-ab65-353c39ca04ea service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.186198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-1bacd5cb-2a4b-4849-9085-003a67757766 req-24114d1f-c695-4473-ab65-353c39ca04ea service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:20.253103 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-1bacd5cb-2a4b-4849-9085-003a67757766 req-24114d1f-c695-4473-ab65-353c39ca04ea service nova] Creating event network-changed:88e3b07b-0347-4c81-a78d-450830d8f450 for instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 on hv-cinder-83699 Jun 03 16:26:20.270015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2035926710"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:20.270556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:20.271676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-1bacd5cb-2a4b-4849-9085-003a67757766 req-24114d1f-c695-4473-ab65-353c39ca04ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117769 Jun 03 16:26:20.274830 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 587/1202] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:20.308749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.309199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:20.309997 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.327012 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:20.537295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.network.security_group_api [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Removing security group 851f2bb5-1c5b-4e83-a416-39aca1f3186f from port 25a621ae-2091-4b52-92c0-c980de0c7607 Jun 03 16:26:20.607722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:20.608430 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:20.617157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.617610 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:20.619417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.619866 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:20.910885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:20.923131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:20.928547 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:20.931787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-36496340-f70e-4725-be2b-9966f1e8efd1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.327264 Jun 03 16:26:20.944236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 588/1203] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:20 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:20.950937 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:20.952107 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:20.959122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.959946 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:20.960939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:20.961730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:21.153171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:21.162876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a9b689e4-92b3-493e-92d0-86bc8ff054d1 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.217110 Jun 03 16:26:21.164072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 589/1204] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:20 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:21.212441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ec50806f-d871-4ccf-91bc-990268f022c1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/action" status: 202 len: 0 microversion: 2.1 time: 0.946975 Jun 03 16:26:21.213052 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 616/1205] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:26:20 2022] POST /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:26:21.244659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-723370d9-e7af-47a2-8055-3686cc6d328f req-fe265bd8-3390-4f8c-98c7-993109687533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:21.266597 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-723370d9-e7af-47a2-8055-3686cc6d328f req-fe265bd8-3390-4f8c-98c7-993109687533 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:21.267863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-723370d9-e7af-47a2-8055-3686cc6d328f req-fe265bd8-3390-4f8c-98c7-993109687533 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:21.294845 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-723370d9-e7af-47a2-8055-3686cc6d328f req-fe265bd8-3390-4f8c-98c7-993109687533 service nova] Creating event network-changed:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:26:21.300619 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-723370d9-e7af-47a2-8055-3686cc6d328f req-fe265bd8-3390-4f8c-98c7-993109687533 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061550 Jun 03 16:26:21.301882 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 590/1206] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:21.951080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:21.954230 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:21.962758 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:21.963326 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:21.964252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:21.967581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:22.183543 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:22.184360 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:22.191393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:22.192347 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:22.193195 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:22.193694 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:22.220750 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:22.241910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:22.245405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:22.249868 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2a3ad3a3-2370-4ca2-96cb-375b10c5bbeb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.301404 Jun 03 16:26:22.251451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 617/1207] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:21 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:22.451795 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:22.460371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-44033c77-f222-4b04-8a27-2079f14869a5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.282937 Jun 03 16:26:22.461327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 591/1208] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:22 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:22.788742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:22.789238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:22.801228 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:22.801680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:22.802517 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:22.802986 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:22.901185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lazy-loading 'services' on Instance uuid dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:26:23.038904 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-16589b65-cdec-4320-9aa6-b4780dbaadf1 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments/249e2bc4-80fc-4398-ba42-da71ce29746f" status: 202 len: 0 microversion: 2.1 time: 0.254758 Jun 03 16:26:23.039845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 618/1209] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:26:22 2022] DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments/249e2bc4-80fc-4398-ba42-da71ce29746f => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:26:23.049514 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:23.050461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:23.058188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.059265 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.060298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.061114 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.114587 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c084da83-517d-433d-b593-b9f912dab245 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069387 Jun 03 16:26:23.115979 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 592/1210] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:26:23 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:23.269144 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:23.269962 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:23.279890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.280620 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.281650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.282307 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.321705 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-52d1e706-3112-4046-b48e-b2a6aecbe22b req-5f4fe18e-df56-43e7-96e9-83574c940f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:23.330904 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-52d1e706-3112-4046-b48e-b2a6aecbe22b req-5f4fe18e-df56-43e7-96e9-83574c940f8e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.331693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-52d1e706-3112-4046-b48e-b2a6aecbe22b req-5f4fe18e-df56-43e7-96e9-83574c940f8e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.348053 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-52d1e706-3112-4046-b48e-b2a6aecbe22b req-5f4fe18e-df56-43e7-96e9-83574c940f8e service nova] Creating event network-changed:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:26:23.354646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-52d1e706-3112-4046-b48e-b2a6aecbe22b req-5f4fe18e-df56-43e7-96e9-83574c940f8e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037059 Jun 03 16:26:23.355846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 593/1211] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:23.443145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:23.452871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:23.454398 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:23.455781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7e8387d6-5e52-4333-a98c-cd0796de73fc tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.190823 Jun 03 16:26:23.456348 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 619/1212] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:23 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:23.486171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:23.488018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:23.501519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.502259 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.503417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:23.504324 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:23.701206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:23.709640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8e97ddf4-93bf-48fe-af77-eec664947749 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.229485 Jun 03 16:26:23.710488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 594/1213] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:23 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:24.128665 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:24.130173 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:24.137964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.138427 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.139968 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.141005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.173598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f1c86474-e841-4169-aca1-4ed3921b12f6 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049458 Jun 03 16:26:24.174599 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 620/1214] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:26:24 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:26:24.185514 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:24.186688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:24.196962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.197416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.198417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.198860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.303530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] HTTP exception thrown: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 is not attached to volume 249e2bc4-80fc-4398-ba42-da71ce29746f Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Request method failure captured: Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments/249e2bc4-80fc-4398-ba42-da71ce29746f HTTP/1.1 Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjUnP7IJ2CRpBtVqzVUw0wyVvY91WQnvHWJ_O652YQtBrkKkNWcFJBa__EVRWqnmO1m_bCExrdUu8Q_uVvDrPTLJapuOKZsOTYB-Fb8jELvSjYa5gErnOEE2zSSiX833vhjNuTPdW3pq6oCMjH72vpyHMNtROowob4YkhU9uAVeSD1I Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 566b367dc7504d3091558cfd6f35bfa9 Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-TestMinimumBasicScenario-2021813294 Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:26:24.311431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/566b367dc7504d3091558cfd6f35bfa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/566b367dc7504d3091558cfd6f35bfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/566b367dc7504d3091558cfd6f35bfa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_566b367dc7504d3091558cfd6f35bfa9"}]}] Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-TestMinimumBasicScenario-2021813294 Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 566b367dc7504d3091558cfd6f35bfa9 Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2021813294 Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-TestMinimumBasicScenario-2021813294-project Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 1e415e30c70d441991187b13c229ee18 Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-TestMinimumBasicScenario-2021813294-project Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:26:24.313171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 is not attached to volume 249e2bc4-80fc-4398-ba42-da71ce29746f Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'server_id': 'dfb72b6d-0abe-4bb4-90f6-a5a099a141b0', 'id': '249e2bc4-80fc-4398-ba42-da71ce29746f'} Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 249e2bc4-80fc-4398-ba42-da71ce29746f. Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:26:24.314443 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 is not attached to volume 249e2bc4-80fc-4398-ba42-da71ce29746f Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 is not attached to volume 249e2bc4-80fc-4398-ba42-da71ce29746f Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:24.316035 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Returning 404 to user: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 is not attached to volume 249e2bc4-80fc-4398-ba42-da71ce29746f {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:26:24.317366 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c09064cf-c328-4bce-8d27-95229b769eed tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments/249e2bc4-80fc-4398-ba42-da71ce29746f" status: 404 len: 154 microversion: 2.1 time: 0.132284 Jun 03 16:26:24.325419 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 595/1215] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:26:24 2022] DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0/os-volume_attachments/249e2bc4-80fc-4398-ba42-da71ce29746f => generated 154 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:26:24.475526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:24.476150 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:24.483917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.485136 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.487051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.487776 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.634703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:24.649283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:24.655435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:24.656622 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5aa6ad06-f1d0-4582-8994-4cf50d6257e7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.185659 Jun 03 16:26:24.657442 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 621/1216] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:24 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:24.726880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:24.728064 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:24.735598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.736273 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.737232 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:24.737663 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:24.886016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:24.897000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-091e94fe-1cef-4caf-a39b-744382377755 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.174781 Jun 03 16:26:24.897669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 596/1217] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:24 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:25.460766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:25.461250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:25.468734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.469179 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.469942 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.470378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.494966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:26:25.583886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b35bc21e-db9e-4a64-a987-663c928ef18d tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 204 len: 0 microversion: 2.1 time: 0.122563 Jun 03 16:26:25.584915 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 622/1218] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:26:25 2022] DELETE /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:26:25.594110 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:25.595015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:25.613438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.613914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.614699 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.615341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.676282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:25.677006 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:25.698111 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.698934 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.699787 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.700235 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.722005 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:25.866698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:25.876150 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5257600b-2535-4833-b150-8c8a341ae9ae tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1553 microversion: 2.1 time: 0.286381 Jun 03 16:26:25.877499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 597/1219] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:25 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:25.883154 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:25.897218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:25.898748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:25.900579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ea6e1de0-8ef2-4903-9b62-00fde1629862 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.228638 Jun 03 16:26:25.901147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 623/1220] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:25 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:25.914439 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:25.915721 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:25.922072 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.922787 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:25.923608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:25.924055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:26.055238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:26.062286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e91e73ef-d80e-4544-b072-e80b129ac0f4 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.152129 Jun 03 16:26:26.063050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 598/1221] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:25 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:26.902550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:26.903284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:26.913984 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:26.914649 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:26.915667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:26.916110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:26.918411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:26.919025 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:26.925748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:26.926192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:26.926966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:26.927426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:27.069657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:27.078977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-42c19f80-0efc-4ee1-9d4d-8a92a92cc933 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1553 microversion: 2.1 time: 0.185675 Jun 03 16:26:27.079591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 624/1222] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:26 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:27.084302 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:27.085974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:27.087389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:27.093554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:27.095004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:27.096211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-11c27a01-b1ec-4510-b53a-12bb124a564a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.182088 Jun 03 16:26:27.099670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:27.100840 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:27.101831 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:27.103017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:27.107824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 599/1223] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:26 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:27.277407 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:27.287178 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a29c0504-7ede-4717-a53a-3d4122ff6d8d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.205043 Jun 03 16:26:27.297830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 625/1224] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:27 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:27.330193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-83326e97-d3c2-4de0-b189-4edcae39437c req-c2bc79a7-44d9-42d2-a429-fe2d40984e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256059e7-995a-4b7d-9439-f32447aca406", "name": "network-vif-plugged", "status": "completed", "tag": "81c8deba-9996-499e-b7d9-9e60b5cf128c"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:27.340812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-83326e97-d3c2-4de0-b189-4edcae39437c req-c2bc79a7-44d9-42d2-a429-fe2d40984e15 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:27.347086 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-83326e97-d3c2-4de0-b189-4edcae39437c req-c2bc79a7-44d9-42d2-a429-fe2d40984e15 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:27.359475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-83326e97-d3c2-4de0-b189-4edcae39437c req-c2bc79a7-44d9-42d2-a429-fe2d40984e15 service nova] Creating event network-vif-plugged:81c8deba-9996-499e-b7d9-9e60b5cf128c for instance 256059e7-995a-4b7d-9439-f32447aca406 on hv-cinder-83699 Jun 03 16:26:27.369575 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-83326e97-d3c2-4de0-b189-4edcae39437c req-c2bc79a7-44d9-42d2-a429-fe2d40984e15 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042892 Jun 03 16:26:27.370320 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 600/1225] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:26:28.096870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:28.097490 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:28.103890 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:28.104571 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:28.105543 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:28.106156 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:28.115671 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:28.117000 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:28.125256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:28.125702 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:28.126656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:28.127255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:28.280482 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:28.295640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:28.299735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:28.302770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a0e6c90f-9780-4aaa-b34a-ee7c3ee6950b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.191406 Jun 03 16:26:28.313952 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 601/1226] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:28 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:28.313952 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:28.314396 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:28.314505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:28.318491 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-780e0e0d-2392-45af-b9c7-246421d0c18c tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1553 microversion: 2.1 time: 0.225520 Jun 03 16:26:28.319076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 626/1227] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:28 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:28.321936 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:28.322457 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:28.323460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:28.323966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:28.345262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=100 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:28.464126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:28.473230 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e8cd044e-705c-473b-a4d7-e794de2b31fd tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.168226 Jun 03 16:26:28.473804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 602/1228] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:28 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:29.325447 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:29.334264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:29.346564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:29.347199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:29.350723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.364524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.364524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.364524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.364935 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.365356 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.366149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.371329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.552027 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:29.580960 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:29.584788 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:29.586216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-05c69ef2-70c2-42a5-8434-ad4a392f44b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.268437 Jun 03 16:26:29.587212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 627/1229] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:29 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:29.593389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:29.594690 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:29.602636 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.603114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.606023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.606669 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.728224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e415e30c70d441991187b13c229ee18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566b367dc7504d3091558cfd6f35bfa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:29.739075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e08b435f-a14c-447b-b434-70fb03b78d6f tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 200 len: 1553 microversion: 2.1 time: 0.396214 Jun 03 16:26:29.739912 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 603/1230] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:29 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 1553 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:29.782544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:29.792151 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f45d147d-e4d9-440f-bb81-13d36111df5c tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1265 microversion: 2.1 time: 0.203819 Jun 03 16:26:29.793079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 628/1231] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:29 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:29.906999 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-5010de1b-d8d3-44ee-a7a6-3348894b6446 req-27e826ff-7b25-46e9-8858-53e9714b891a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb72b6d-0abe-4bb4-90f6-a5a099a141b0", "name": "network-vif-deleted", "tag": "25a621ae-2091-4b52-92c0-c980de0c7607"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:29.916505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5010de1b-d8d3-44ee-a7a6-3348894b6446 req-27e826ff-7b25-46e9-8858-53e9714b891a service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:29.917231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5010de1b-d8d3-44ee-a7a6-3348894b6446 req-27e826ff-7b25-46e9-8858-53e9714b891a service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:29.933472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-5010de1b-d8d3-44ee-a7a6-3348894b6446 req-27e826ff-7b25-46e9-8858-53e9714b891a service nova] Creating event network-vif-deleted:25a621ae-2091-4b52-92c0-c980de0c7607 for instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 on hv-cinder-83699 Jun 03 16:26:29.939250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-5010de1b-d8d3-44ee-a7a6-3348894b6446 req-27e826ff-7b25-46e9-8858-53e9714b891a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197831 Jun 03 16:26:29.940062 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 604/1232] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:30.606701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:30.607403 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:30.614091 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.614550 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.615378 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.616067 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.745361 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:30.753859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:30.755423 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:30.756743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-be22ba51-c88f-42fa-8d57-ba82acdce17b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1738 microversion: 2.20 time: 0.154651 Jun 03 16:26:30.757203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:30.757719 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 629/1233] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:30 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:30.758659 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] [instance: dfb72b6d-0abe-4bb4-90f6-a5a099a141b0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:30.766074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.766528 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.767332 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.767780 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.783515 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] HTTP exception thrown: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 could not be found. Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Request method failure captured: Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 HTTP/1.1 Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjUnP7IJ2CRpBtVqzVUw0wyVvY91WQnvHWJ_O652YQtBrkKkNWcFJBa__EVRWqnmO1m_bCExrdUu8Q_uVvDrPTLJapuOKZsOTYB-Fb8jELvSjYa5gErnOEE2zSSiX833vhjNuTPdW3pq6oCMjH72vpyHMNtROowob4YkhU9uAVeSD1I Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 566b367dc7504d3091558cfd6f35bfa9 Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-TestMinimumBasicScenario-2021813294 Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:26:30.785168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/566b367dc7504d3091558cfd6f35bfa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/566b367dc7504d3091558cfd6f35bfa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/566b367dc7504d3091558cfd6f35bfa9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_566b367dc7504d3091558cfd6f35bfa9"}]}] Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-TestMinimumBasicScenario-2021813294 Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 566b367dc7504d3091558cfd6f35bfa9 Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2021813294 Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-TestMinimumBasicScenario-2021813294-project Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 1e415e30c70d441991187b13c229ee18 Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-TestMinimumBasicScenario-2021813294-project Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 could not be found. Jun 03 16:26:30.786761 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'dfb72b6d-0abe-4bb4-90f6-a5a099a141b0'} Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 could not be found. Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:26:30.787637 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 could not be found. Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 could not be found. Jun 03 16:26:30.788856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:26:30.790490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Returning 404 to user: Instance dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:26:30.790490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-94064e82-3b2c-4721-ada6-54f049625448 tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0" status: 404 len: 111 microversion: 2.1 time: 0.034207 Jun 03 16:26:30.790490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 605/1234] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:30 2022] GET /compute/v2.1/servers/dfb72b6d-0abe-4bb4-90f6-a5a099a141b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 16:26:30.795671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-7a93c591-0752-467f-81b7-f686e7d644bd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] Calling method '.version_select at 0x7fb5c5cb5f70>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:30.809370 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:30.809898 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:30.814007 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-7a93c591-0752-467f-81b7-f686e7d644bd tempest-TestMinimumBasicScenario-2021813294 tempest-TestMinimumBasicScenario-2021813294-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-914771560" status: 202 len: 0 microversion: 2.1 time: 0.022048 Jun 03 16:26:30.814569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 630/1235] 10.222.0.41 () {58 vars in 1268 bytes} [Fri Jun 3 16:26:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-914771560 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:26:30.816060 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.816509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.817266 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.818183 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.953739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:30.961277 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-35fa6e75-b7bc-4ef3-bd83-14eff5e7041d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1453 microversion: 2.1 time: 0.156260 Jun 03 16:26:30.962481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 606/1236] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:30 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:26:30.978315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:30.978931 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:30.985114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.985800 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:30.986585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:30.987066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:31.122738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:31.130737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f06d60a2-8775-4f9c-a6c9-f6b46b2e71be tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1453 microversion: 2.1 time: 0.157085 Jun 03 16:26:31.131334 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 631/1237] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:26:30 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:26:31.775406 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:31.776171 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:31.783132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:31.783696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:31.784610 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:31.785294 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:32.351887 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:32.360696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:32.362228 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:32.363516 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-56b1bf64-1f06-4e11-b7c6-9b0264627a41 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1720 microversion: 2.20 time: 0.592460 Jun 03 16:26:32.374985 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 607/1238] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:31 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1720 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:33.128336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-2bfb4016-d8ea-4576-83b5-9eecc7a5a4aa req-1fb19a8d-3b94-402c-848c-a55708a54ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256059e7-995a-4b7d-9439-f32447aca406", "tag": "81c8deba-9996-499e-b7d9-9e60b5cf128c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:33.137236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-2bfb4016-d8ea-4576-83b5-9eecc7a5a4aa req-1fb19a8d-3b94-402c-848c-a55708a54ba6 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:33.137940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-2bfb4016-d8ea-4576-83b5-9eecc7a5a4aa req-1fb19a8d-3b94-402c-848c-a55708a54ba6 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:33.150437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-2bfb4016-d8ea-4576-83b5-9eecc7a5a4aa req-1fb19a8d-3b94-402c-848c-a55708a54ba6 service nova] Creating event network-changed:81c8deba-9996-499e-b7d9-9e60b5cf128c for instance 256059e7-995a-4b7d-9439-f32447aca406 on hv-cinder-83699 Jun 03 16:26:33.155765 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-2bfb4016-d8ea-4576-83b5-9eecc7a5a4aa req-1fb19a8d-3b94-402c-848c-a55708a54ba6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031032 Jun 03 16:26:33.156915 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 632/1239] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:26:33.322091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-daa6d36c-e4cb-4492-8797-108ba72947f2 req-314a31de-88cb-4a60-bce4-43ee759d47c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "name": "network-vif-unplugged", "status": "completed", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:33.330942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-daa6d36c-e4cb-4492-8797-108ba72947f2 req-314a31de-88cb-4a60-bce4-43ee759d47c5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:33.331677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-daa6d36c-e4cb-4492-8797-108ba72947f2 req-314a31de-88cb-4a60-bce4-43ee759d47c5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:33.343734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-daa6d36c-e4cb-4492-8797-108ba72947f2 req-314a31de-88cb-4a60-bce4-43ee759d47c5 service nova] Creating event network-vif-unplugged:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:26:33.351076 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-daa6d36c-e4cb-4492-8797-108ba72947f2 req-314a31de-88cb-4a60-bce4-43ee759d47c5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033035 Jun 03 16:26:33.352075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 608/1240] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:26:33.382545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:33.383249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:33.393363 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:33.394233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:33.395321 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:33.396003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:33.572417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:33.582327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:33.584062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:33.585507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-59e2c313-d414-40b1-bb6e-7b63a2a92ab6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1720 microversion: 2.20 time: 0.206979 Jun 03 16:26:33.586608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 633/1241] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:33 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:34.605391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:34.606218 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:34.612470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:34.612918 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:34.613760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:34.614197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:34.897542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:34.909913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:34.909913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:34.909913 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c081b9a6-feaf-4f5d-b663-b79ac14379a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1720 microversion: 2.20 time: 0.308754 Jun 03 16:26:34.920624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 609/1242] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:34 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1720 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:35.927602 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:35.928209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:35.934246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:35.934696 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:35.935489 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:35.935927 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.062294 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:36.070338 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:36.072428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:36.073591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4c3b2210-9d55-443d-94bf-d938a6520fb1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1663 microversion: 2.20 time: 0.150106 Jun 03 16:26:36.084261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 634/1243] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:35 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:36.091678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37f662f3-2d1e-49be-a53a-e5ccfa9f6f9c"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:36.092751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:36.099182 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.099697 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.100481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.100923 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.371269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-87e85609-2600-485d-a210-58a73548c113 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283981 Jun 03 16:26:36.371983 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 610/1244] 10.222.0.41 () {62 vars in 1363 bytes} [Fri Jun 3 16:26:36 2022] POST /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 16:26:36.513353 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:36.513856 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:36.520809 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.521259 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.522292 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.522724 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.767094 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-016ff2c5-a039-4425-8eec-940f8bc9765b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-volume_attachments/37f662f3-2d1e-49be-a53a-e5ccfa9f6f9c" status: 202 len: 0 microversion: 2.20 time: 0.257665 Jun 03 16:26:36.767805 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 635/1245] 10.222.0.41 () {60 vars in 1456 bytes} [Fri Jun 3 16:26:36 2022] DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-volume_attachments/37f662f3-2d1e-49be-a53a-e5ccfa9f6f9c => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:26:36.825093 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:26:36.825803 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:36.831824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.832269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.833025 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.833487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.932504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cb102ec3-bc35-44ee-b86e-b59132846f98 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "POST /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/action" status: 202 len: 0 microversion: 2.20 time: 0.111301 Jun 03 16:26:36.933457 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 611/1246] 10.222.0.41 () {62 vars in 1318 bytes} [Fri Jun 3 16:26:36 2022] POST /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:26:36.941475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:36.943213 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:36.952642 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.953323 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:36.954506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:36.955247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:37.182474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:37.200180 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:37.203075 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:37.205390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8710682b-8d8c-408d-a887-7e486f4ba4a3 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1671 microversion: 2.20 time: 0.268083 Jun 03 16:26:37.206159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 636/1247] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:36 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:38.231864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:38.233271 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:38.238811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:38.240598 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:38.241769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:38.242447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:38.542363 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:38.562393 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:38.564500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:38.565850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d55b8c7f-80f6-4f46-912d-59d4c11a94db tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.345746 Jun 03 16:26:38.566556 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 612/1248] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:38 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:39.586442 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:39.587785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:39.597327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:39.597819 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:39.610584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:39.611274 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:39.814581 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:39.823585 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:39.825169 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:39.826902 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-522bd7cd-71aa-4000-ae81-15c42039c2c0 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.245935 Jun 03 16:26:39.844354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 637/1249] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:39 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:40.848885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:40.849505 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:40.857197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:40.857653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:40.858430 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:40.858872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:40.992221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:41.000603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:41.002262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:41.003628 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fa0a990a-adea-4311-a1eb-9252753a09b6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.158794 Jun 03 16:26:41.004266 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 613/1250] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:40 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:42.022206 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:42.022726 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:42.029284 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:42.029734 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:42.030502 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:42.031022 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:42.165935 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:42.174302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:42.175976 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:42.177184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-af2acdef-f208-41e4-ac23-f5883f074781 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.159179 Jun 03 16:26:42.177742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 638/1251] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:42 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:43.195660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:43.196206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:43.199338 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=76 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:43.204790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:43.205239 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:43.206011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:43.206444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:43.347445 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:43.356997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:43.358536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:43.359745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7d6fdcca-c223-4651-a793-8d884804b599 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.168207 Jun 03 16:26:43.360317 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 614/1252] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:43 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:44.378905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:44.379543 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:44.382019 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:44.388469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:44.388916 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:44.389692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:44.390134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:44.406356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:44.535897 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:44.543926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:44.545430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:44.546589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3be60140-b8f5-49bb-9038-f0b6a9f0961a tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.171574 Jun 03 16:26:44.547142 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 639/1253] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:44 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:45.565454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:45.566096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:45.572909 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:45.573363 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:45.574165 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:45.574601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:45.707228 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:45.715248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:45.716770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:45.717911 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-9ee0a13e-8153-40da-98d4-0d04bc4a9559 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.156387 Jun 03 16:26:45.718520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 615/1254] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:45 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:46.735858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:46.736905 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:46.743732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:46.744179 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:46.744974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:46.745409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:46.879866 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:46.888031 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:46.889551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:46.890754 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-75029479-dde8-4e8b-b09b-f42ea76ed926 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.158728 Jun 03 16:26:46.891386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 640/1255] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:46 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:47.909676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:47.910960 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:47.918595 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:47.919197 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:47.920095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:47.920656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:48.311773 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:48.319969 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:48.321484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:48.322662 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-94a57cb7-8e91-4dc0-aaf0-5b2889454b66 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.416953 Jun 03 16:26:48.323224 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 616/1256] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:47 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:49.345780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:49.346441 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:49.353566 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:49.354595 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:49.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:49.355896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:49.488243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:49.497731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:49.499419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:49.500677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9e6a7a74-28ad-4e48-9171-e717674206b7 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.163483 Jun 03 16:26:49.501289 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 641/1257] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:49 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:50.519730 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:50.520344 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:50.527155 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:50.527642 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:50.528414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:50.528852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:50.547836 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:26:50.665665 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:50.674193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:50.675726 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:50.676891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ffd58141-8631-4e1a-9f58-ba8548990033 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.161225 Jun 03 16:26:50.677644 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 617/1258] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:50 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:51.695604 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:51.696219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:51.703534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:51.704039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:51.704830 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:51.705274 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:51.843924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:51.852791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:51.854941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:51.856451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3135701b-0c0f-4853-ac85-461df0ada944 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.164776 Jun 03 16:26:51.857089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 642/1259] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:51 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:52.874478 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:52.875865 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:52.881710 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:52.882163 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:52.882931 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:52.883392 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:53.020077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:53.028746 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:53.030257 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:53.031444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8b3cc54f-4bc1-4456-ba50-bcb9454cd3e6 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.161455 Jun 03 16:26:53.031996 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 618/1260] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:52 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:54.049032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:54.049632 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:54.056356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:54.056814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:54.057634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:54.058574 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:54.184110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:54.191953 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:54.193461 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:54.194611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-874f39eb-0e6b-4a0c-912d-f2bd1327e4cf tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.149430 Jun 03 16:26:54.195185 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 643/1261] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:54 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:26:55.212674 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:55.213278 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:55.220239 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:55.220681 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:55.221440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:55.221875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:55.346241 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:55.354006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:55.356192 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:55.357333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-59bf4a3b-309f-4b92-b517-f8249ca2a066 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.148547 Jun 03 16:26:55.357879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 619/1262] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:55 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:56.375324 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:56.375973 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:56.382435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:56.382887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:56.383692 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:56.384135 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:56.514750 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:56.522937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:56.524470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:56.525617 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-29b6496c-c3e1-47dd-8f68-a0a3090a2226 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.154311 Jun 03 16:26:56.526172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 644/1263] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:56 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:57.544822 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:57.545367 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:57.551953 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:57.552401 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:57.553157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:57.553588 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:57.681187 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:57.689425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:57.690931 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:57.692113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-79ae42ab-0dc6-4704-9565-0163f9379f3b tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.151381 Jun 03 16:26:57.692662 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 620/1264] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:57 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:58.715563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:58.716183 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:58.722644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:58.723099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:58.723907 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:58.724354 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:58.849319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:58.857157 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:58.858682 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:26:58.859859 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b1a456a3-a7bd-4678-8ba0-1577b468e591 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.148854 Jun 03 16:26:58.860413 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 645/1265] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:58 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:26:59.877684 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:26:59.878298 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:26:59.884609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:59.885056 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:26:59.885817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:26:59.886256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:00.024854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:00.033244 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:00.034749 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:00.035934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f533eda1-4793-4df3-9454-2752c5fc87bd tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.162155 Jun 03 16:27:00.036495 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 621/1266] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:26:59 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:01.054545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:01.055267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:01.062299 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:01.062748 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:01.063549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:01.063986 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:01.194329 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:01.202172 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:01.203693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:01.204845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dfc0478a-209d-49f1-9322-e13293128d63 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.154188 Jun 03 16:27:01.205404 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 646/1267] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:27:01 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:02.222997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:02.223728 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:02.231166 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:02.231642 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:02.232409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:02.232856 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:02.357132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:02.365040 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:02.366559 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:02.367757 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b32091c2-1841-48c7-88cc-6a32c6b0710f tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.148676 Jun 03 16:27:02.368321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 622/1268] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:27:02 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:03.385844 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:03.386446 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:03.393547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:03.394034 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:03.394849 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:03.395351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:03.534437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:03.543088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:03.544644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:03.545803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9ad5dcad-a498-421a-a360-75115474e867 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.163931 Jun 03 16:27:03.546351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 647/1269] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:27:03 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:03.602024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-5e0ea36c-c480-4709-a6d3-5b6a8822bece req-7c24213f-cc6c-4425-9a91-c3f1fbfbe1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "name": "network-vif-plugged", "status": "completed", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:27:03.610574 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5e0ea36c-c480-4709-a6d3-5b6a8822bece req-7c24213f-cc6c-4425-9a91-c3f1fbfbe1d0 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:03.611018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-5e0ea36c-c480-4709-a6d3-5b6a8822bece req-7c24213f-cc6c-4425-9a91-c3f1fbfbe1d0 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:03.621554 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-5e0ea36c-c480-4709-a6d3-5b6a8822bece req-7c24213f-cc6c-4425-9a91-c3f1fbfbe1d0 service nova] Creating event network-vif-plugged:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:27:03.626461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-5e0ea36c-c480-4709-a6d3-5b6a8822bece req-7c24213f-cc6c-4425-9a91-c3f1fbfbe1d0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225323 Jun 03 16:27:03.627028 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 623/1270] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:27:04.563218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:04.563794 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:04.569893 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:04.570351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:04.571129 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:04.571601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:04.695941 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:04.704531 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:04.706086 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:04.707255 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4e35a218-a2ae-4867-8c26-d1e4ced35493 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.148242 Jun 03 16:27:04.707842 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 648/1271] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:27:04 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:04.814956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:04.815512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:04.821676 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:04.822126 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:04.822894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:04.823867 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:04.849050 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-28dd9fd6-2d39-45d7-bcd7-12c736018fb9 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/ips" status: 200 len: 145 microversion: 2.1 time: 0.168441 Jun 03 16:27:04.849596 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 624/1272] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:27:04 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/ips => generated 145 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:27:05.725744 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:05.726365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:05.733488 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:05.733943 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:05.734753 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:05.735194 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:05.865943 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:05.874372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:05.875924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:05.877119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-64c4b7e0-2523-4006-8ae3-4e57c6c8fe7d tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1729 microversion: 2.20 time: 0.155179 Jun 03 16:27:05.877736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 649/1273] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:27:05 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:06.895316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:06.895968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:06.902612 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:06.903063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:06.903844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:06.904276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:07.030586 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:07.038361 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:07.039895 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:07.041108 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-19ea6b01-a667-41e0-aadf-0f6b11151a95 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1716 microversion: 2.20 time: 0.149619 Jun 03 16:27:07.041670 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 625/1274] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:27:06 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:27:07.206107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb881ea7-dfd8-4012-8e98-4557d8734c12"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:27:07.207247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:07.213677 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:07.214598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:07.215440 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:07.215877 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:07.445718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c5e8a474-fa9a-43fa-bd52-8bd5c3d41f3e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243360 Jun 03 16:27:07.446565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 650/1275] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:27:07 2022] POST /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:14.923805 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:14.924740 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:14.927351 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=24 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:14.932488 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:14.932939 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:14.934199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:14.934640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:14.963434 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c2906b84-f23d-4ec5-98c3-db1f69bdb20e tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Jun 03 16:27:14.963981 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 626/1276] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:27:14 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:14.975082 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:14.975605 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:14.977524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=24 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:14.983346 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:14.983798 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:14.984564 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:14.984998 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:14.989016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:15.015762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5309d201-4faa-42d4-a116-b08f25957229 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/bb881ea7-dfd8-4012-8e98-4557d8734c12" status: 200 len: 194 microversion: 2.1 time: 0.045722 Jun 03 16:27:15.016332 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 651/1277] 10.222.0.41 () {58 vars in 1412 bytes} [Fri Jun 3 16:27:14 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/bb881ea7-dfd8-4012-8e98-4557d8734c12 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:16.329409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec64a34e-2931-4e58-93d7-fd315a1bc81a"}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:27:16.330407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:16.337120 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:16.337567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:16.338320 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:16.338808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:16.571193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5118ed35-44b1-4ca6-a415-b09513ce2f8d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "POST /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245603 Jun 03 16:27:16.571824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 627/1278] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:27:16 2022] POST /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:24.045132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:24.046112 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:24.052612 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:24.053062 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:24.053818 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:24.054255 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:24.083965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e170c50e-76c5-4921-81a0-fbdf061f366d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042817 Jun 03 16:27:24.084520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 652/1279] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:27:24 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:24.225469 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:24.226005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:24.233022 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:24.233475 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:24.234250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:24.234692 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:24.238481 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:27:24.264808 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2caa017b-6628-43e4-ba7a-88e51f3ac928 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/bb881ea7-dfd8-4012-8e98-4557d8734c12" status: 200 len: 194 microversion: 2.1 time: 0.043745 Jun 03 16:27:24.265395 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 628/1280] 10.222.0.41 () {58 vars in 1412 bytes} [Fri Jun 3 16:27:24 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/bb881ea7-dfd8-4012-8e98-4557d8734c12 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:24.275262 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:24.275790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:24.282392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:24.282854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:24.283670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:24.284119 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:24.362188 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lazy-loading 'services' on Instance uuid 49c8a0f7-905d-42bd-ae2b-fd92576529fb {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:27:24.432847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d8fb6560-2481-41a7-8308-44b1daef8ca0 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/bb881ea7-dfd8-4012-8e98-4557d8734c12" status: 202 len: 0 microversion: 2.1 time: 0.161654 Jun 03 16:27:24.433437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 653/1281] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:27:24 2022] DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/bb881ea7-dfd8-4012-8e98-4557d8734c12 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:27:26.598651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:26.599146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:26.605673 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:26.606121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:26.606876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:26.607323 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:26.635419 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-283ff082-4bd4-4f6f-a78d-70090b60cc7a tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/ec64a34e-2931-4e58-93d7-fd315a1bc81a" status: 200 len: 194 microversion: 2.1 time: 0.040772 Jun 03 16:27:26.635973 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 629/1282] 10.222.0.41 () {58 vars in 1412 bytes} [Fri Jun 3 16:27:26 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/ec64a34e-2931-4e58-93d7-fd315a1bc81a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:26.645965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:26.646559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:26.653591 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:26.654051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:26.655336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:26.655787 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:26.733608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lazy-loading 'services' on Instance uuid 49c8a0f7-905d-42bd-ae2b-fd92576529fb {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:27:26.802016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-473007ca-db56-4379-86e2-87fee8e303f1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/ec64a34e-2931-4e58-93d7-fd315a1bc81a" status: 202 len: 0 microversion: 2.1 time: 0.160075 Jun 03 16:27:26.802530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 654/1283] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:27:26 2022] DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments/ec64a34e-2931-4e58-93d7-fd315a1bc81a => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:27:27.956216 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:27.957203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:27.963611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:27.964065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:27.964826 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:27.965264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:27.993790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2638f3aa-bae4-412e-b8fe-705847a2e66c tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041632 Jun 03 16:27:27.994362 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 630/1284] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:27:27 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:27:28.098422 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:28.099475 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:28.106458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:28.106911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:28.107732 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:28.108766 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:28.140151 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-506c1217-cae0-46ae-ac26-6dbd3273e39d tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045957 Jun 03 16:27:28.140709 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 655/1285] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:27:28 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 16:27:28.200758 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:28.201260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:28.207287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:28.207772 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:28.208540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:28.208986 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:28.234255 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:27:28.311277 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-843dde1d-3f3e-484d-8617-9a50ee0c3ba4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 204 len: 0 microversion: 2.1 time: 0.113958 Jun 03 16:27:28.311902 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 631/1286] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:27:28 2022] DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:27:28.320000 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:28.320611 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:28.326506 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:28.326974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:28.327762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:28.328197 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:28.454252 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:28.461659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-779e0ccf-e5be-486e-812e-4b9d80d58c61 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1674 microversion: 2.1 time: 0.145465 Jun 03 16:27:28.462212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 656/1287] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:28 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:27:29.479804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:29.480545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:29.486967 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:29.487461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:29.488233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:29.488675 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:29.621286 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:29.629247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f541c370-45cd-4275-8953-dc59eb984b66 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1674 microversion: 2.1 time: 0.153719 Jun 03 16:27:29.629805 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 632/1288] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:29 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:27:30.646625 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:30.647243 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:30.654109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:30.654567 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:30.655369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:30.655814 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:30.787940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:30.795409 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-877aa0ed-d8bb-41a6-b7ef-c65d1d64f305 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1674 microversion: 2.1 time: 0.152661 Jun 03 16:27:30.796017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 657/1289] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:30 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:27:31.507565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-49697558-a7d9-494d-9be0-3289d979d12b req-d89be8be-0ffb-4c52-81c3-b6bfe1908e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8a0f7-905d-42bd-ae2b-fd92576529fb", "name": "network-vif-deleted", "tag": "41e725ed-2822-4f59-a76d-137da0e19a16"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:27:31.517349 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-49697558-a7d9-494d-9be0-3289d979d12b req-d89be8be-0ffb-4c52-81c3-b6bfe1908e64 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:31.518291 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-49697558-a7d9-494d-9be0-3289d979d12b req-d89be8be-0ffb-4c52-81c3-b6bfe1908e64 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:31.530128 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-49697558-a7d9-494d-9be0-3289d979d12b req-d89be8be-0ffb-4c52-81c3-b6bfe1908e64 service nova] Creating event network-vif-deleted:41e725ed-2822-4f59-a76d-137da0e19a16 for instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb on hv-cinder-83699 Jun 03 16:27:31.535454 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-49697558-a7d9-494d-9be0-3289d979d12b req-d89be8be-0ffb-4c52-81c3-b6bfe1908e64 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Jun 03 16:27:31.536145 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 633/1290] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:27:31.812930 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:31.813486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:31.820003 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:31.820456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:31.821224 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:31.821659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:31.852115 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:31.852565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:31.853010 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lazy-loading 'fault' on Instance uuid 49c8a0f7-905d-42bd-ae2b-fd92576529fb {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:27:31.894388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68189df1f9b4f9aacfa319381849697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f59694966848829048aee648dddccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:27:31.902294 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4707841d-4e8c-4e99-bcb0-1ee9a6381ddd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 200 len: 1328 microversion: 2.1 time: 0.094007 Jun 03 16:27:31.903995 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 658/1291] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:31 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:27:32.921023 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:32.921731 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:32.927949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:32.928404 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:32.929174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:32.929616 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:32.943207 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] HTTP exception thrown: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Request method failure captured: Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb HTTP/1.1 Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjPB7gIXbgTPvleMb9NQUSdMkgchOItGqKs5OdLDOY9uoXg9N_FVWu_ZI-pE9g_mXrFBRHqH-tQRf32yFTgsy3j9eirUd-0JYxLtvTFFzn2KYzYzkGGd-D9wr6csOzllT3nlny9wL7PKNQmTgaXuuxf_xgxPqtf34h0Y6vz98lLQ2wk Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:27:32.944885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d0f59694966848829048aee648dddccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d0f59694966848829048aee648dddccc"}]}] Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: c68189df1f9b4f9aacfa319381849697 Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:32.946536 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '49c8a0f7-905d-42bd-ae2b-fd92576529fb'} Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:27:32.948269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:32.949908 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:32.951269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Returning 404 to user: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:27:32.951269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-65957ce8-2f25-443b-8165-602fbe77c6e4 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 404 len: 111 microversion: 2.1 time: 0.029995 Jun 03 16:27:32.951269 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 634/1292] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:32 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:27:32.955718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-73bc5116-3686-4459-9ae1-c63f56bbe8cd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '.version_select at 0x7fb5c5cacca0>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:32.975853 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-73bc5116-3686-4459-9ae1-c63f56bbe8cd tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447900901" status: 202 len: 0 microversion: 2.1 time: 0.024607 Jun 03 16:27:32.976419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 659/1293] 10.222.0.41 () {58 vars in 1220 bytes} [Fri Jun 3 16:27:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447900901 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:27:35.830768 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:35.831266 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:35.837640 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:35.838081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:35.838834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:35.839264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:35.852349 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] HTTP exception thrown: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Request method failure captured: Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb HTTP/1.1 Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjPB7gIXbgTPvleMb9NQUSdMkgchOItGqKs5OdLDOY9uoXg9N_FVWu_ZI-pE9g_mXrFBRHqH-tQRf32yFTgsy3j9eirUd-0JYxLtvTFFzn2KYzYzkGGd-D9wr6csOzllT3nlny9wL7PKNQmTgaXuuxf_xgxPqtf34h0Y6vz98lLQ2wk Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:27:35.853850 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d0f59694966848829048aee648dddccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d0f59694966848829048aee648dddccc"}]}] Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: c68189df1f9b4f9aacfa319381849697 Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.855440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '49c8a0f7-905d-42bd-ae2b-fd92576529fb'} Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:27:35.856264 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.857580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.859132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Returning 404 to user: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:27:35.859132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e050d358-ca36-4162-ad67-fe51144a43e1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 404 len: 111 microversion: 2.1 time: 0.029010 Jun 03 16:27:35.859132 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 635/1294] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:27:35 2022] DELETE /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:27:35.863399 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:35.864018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 49c8a0f7-905d-42bd-ae2b-fd92576529fb] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:35.871100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:35.871580 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:35.872358 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:35.872803 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:35.886043 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] HTTP exception thrown: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Request method failure captured: Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb HTTP/1.1 Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjPB7gIXbgTPvleMb9NQUSdMkgchOItGqKs5OdLDOY9uoXg9N_FVWu_ZI-pE9g_mXrFBRHqH-tQRf32yFTgsy3j9eirUd-0JYxLtvTFFzn2KYzYzkGGd-D9wr6csOzllT3nlny9wL7PKNQmTgaXuuxf_xgxPqtf34h0Y6vz98lLQ2wk Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:27:35.887686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d0f59694966848829048aee648dddccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d0f59694966848829048aee648dddccc"}]}] Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: c68189df1f9b4f9aacfa319381849697 Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.889246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '49c8a0f7-905d-42bd-ae2b-fd92576529fb'} Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:27:35.890670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. Jun 03 16:27:35.891966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:35.893032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Returning 404 to user: Instance 49c8a0f7-905d-42bd-ae2b-fd92576529fb could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:27:35.893032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-409de527-13d7-4f20-b3eb-8eb02840f4a1 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb" status: 404 len: 111 microversion: 2.1 time: 0.029508 Jun 03 16:27:35.893032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 660/1295] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:35 2022] GET /compute/v2.1/servers/49c8a0f7-905d-42bd-ae2b-fd92576529fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:27:37.018188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:37.018712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:37.025409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:37.025851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:37.026604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:37.027040 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:37.040687 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] HTTP exception thrown: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Request method failure captured: Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad HTTP/1.1 Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjPB7gIXbgTPvleMb9NQUSdMkgchOItGqKs5OdLDOY9uoXg9N_FVWu_ZI-pE9g_mXrFBRHqH-tQRf32yFTgsy3j9eirUd-0JYxLtvTFFzn2KYzYzkGGd-D9wr6csOzllT3nlny9wL7PKNQmTgaXuuxf_xgxPqtf34h0Y6vz98lLQ2wk Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:27:37.042191 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d0f59694966848829048aee648dddccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d0f59694966848829048aee648dddccc"}]}] Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: c68189df1f9b4f9aacfa319381849697 Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.043783 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '2de1f638-4fee-41e2-bd50-b802f8494fad'} Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:27:37.044580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.045925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.047741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Returning 404 to user: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:27:37.047741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cc507b7f-bce0-4b35-bc4a-b0c933810b69 tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 404 len: 111 microversion: 2.1 time: 0.029706 Jun 03 16:27:37.047741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 636/1296] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:27:37 2022] DELETE /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:27:37.051929 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:27:37.052551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] [instance: 2de1f638-4fee-41e2-bd50-b802f8494fad] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:27:37.059029 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:37.059524 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:37.060291 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:27:37.060729 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:27:37.075825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] HTTP exception thrown: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Request method failure captured: Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad HTTP/1.1 Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjPB7gIXbgTPvleMb9NQUSdMkgchOItGqKs5OdLDOY9uoXg9N_FVWu_ZI-pE9g_mXrFBRHqH-tQRf32yFTgsy3j9eirUd-0JYxLtvTFFzn2KYzYzkGGd-D9wr6csOzllT3nlny9wL7PKNQmTgaXuuxf_xgxPqtf34h0Y6vz98lLQ2wk Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:27:37.077850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d0f59694966848829048aee648dddccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d0f59694966848829048aee648dddccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d0f59694966848829048aee648dddccc"}]}] Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: d0f59694966848829048aee648dddccc Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-131325096 Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: c68189df1f9b4f9aacfa319381849697 Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeTestJSON-131325096-project Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.079429 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '2de1f638-4fee-41e2-bd50-b802f8494fad'} Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:27:37.080405 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. Jun 03 16:27:37.081886 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:27:37.083218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] Returning 404 to user: Instance 2de1f638-4fee-41e2-bd50-b802f8494fad could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:27:37.083218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-cdeea22e-c20a-4cf7-84ed-9d37d9d8723f tempest-AttachVolumeTestJSON-131325096 tempest-AttachVolumeTestJSON-131325096-project] 10.222.0.41 "GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad" status: 404 len: 111 microversion: 2.1 time: 0.031175 Jun 03 16:27:37.083218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 661/1297] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:27:37 2022] GET /compute/v2.1/servers/2de1f638-4fee-41e2-bd50-b802f8494fad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:02.915981 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:02.916602 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:02.919541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:02.920174 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:02.925863 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:02.926320 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:02.927097 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:02.927558 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:02.955564 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-801852be-3d46-4fbe-a999-3cd147ec5132 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/ips" status: 200 len: 151 microversion: 2.1 time: 0.043805 Jun 03 16:28:02.956143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 637/1298] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:28:02 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:04.287786 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3a185bb-4c96-49e3-8dde-08e3f542f72a"}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:04.288893 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:04.292277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:04.295587 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:04.301836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:04.302295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:04.303073 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:04.303530 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:04.562131 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-9698105c-eaae-4f2d-a561-70ee8cb542e9 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "POST /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277964 Jun 03 16:28:04.567017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 662/1299] 10.222.0.41 () {60 vars in 1322 bytes} [Fri Jun 3 16:28:04 2022] POST /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:12.166879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:12.167585 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:12.174188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:12.174635 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:12.175438 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:12.175878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:12.257407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lazy-loading 'services' on Instance uuid 62cd9a4e-635f-422c-86f6-80e40d3f0f43 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:28:12.330431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0de5cd14-606e-46f4-bf03-e0eca7a88b16 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments/d3a185bb-4c96-49e3-8dde-08e3f542f72a" status: 202 len: 0 microversion: 2.1 time: 0.167890 Jun 03 16:28:12.331045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 638/1300] 10.222.0.41 () {58 vars in 1415 bytes} [Fri Jun 3 16:28:12 2022] DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments/d3a185bb-4c96-49e3-8dde-08e3f542f72a => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:28:12.341645 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:12.342435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:12.349669 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:12.350415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:12.351547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:12.352055 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:12.383982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4d5e4f69-2a47-4c3e-b8f3-0da965c42596 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048023 Jun 03 16:28:12.384545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 663/1301] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:28:12 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:28:13.397135 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:13.398211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:13.404899 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:13.405352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:13.407130 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:13.407287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:13.435854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-930410c5-8b3c-40d5-9489-97ee9194c441 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043493 Jun 03 16:28:13.436409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 639/1302] 10.222.0.41 () {58 vars in 1301 bytes} [Fri Jun 3 16:28:13 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 16:28:13.494500 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:13.495056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:13.502072 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:13.502528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:13.503322 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:13.504710 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:13.533224 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Going to try to terminate instance {{(pid=117571) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:28:13.609606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0611477c-1c96-431b-844a-d739b61ffb88 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 204 len: 0 microversion: 2.1 time: 0.119102 Jun 03 16:28:13.610261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 664/1303] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:13 2022] DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:28:13.618506 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:13.619201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:13.626509 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:13.627158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:13.628041 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:13.628548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:13.756889 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:13.764734 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-18c458d2-234f-4ee9-b77a-78f7e8c6dc6c tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1682 microversion: 2.1 time: 0.150152 Jun 03 16:28:13.765819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 640/1304] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:13 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:14.028079 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:14.029092 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:14.035470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.035926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.036708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.037287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.067561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3377abdd-44e1-4561-8910-229d4d041bcb tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044080 Jun 03 16:28:14.068118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 665/1305] 10.222.0.41 () {60 vars in 1342 bytes} [Fri Jun 3 16:28:14 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:14.124975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:14.125579 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:14.131890 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.132442 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.133461 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.133966 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.158851 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:28:14.238928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7d85511d-d228-4aeb-a93a-899696a4d804 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 204 len: 0 microversion: 2.20 time: 0.118438 Jun 03 16:28:14.239567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 641/1306] 10.222.0.41 () {60 vars in 1279 bytes} [Fri Jun 3 16:28:14 2022] DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 16:28:14.251535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:14.251535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:14.255742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.256198 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.256971 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.257413 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.386064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:14.394068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:14.395597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:14.396753 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-01e1dfa3-f7b8-4016-a5fd-387a8d7670ec tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.152689 Jun 03 16:28:14.397303 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 666/1307] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:14 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:28:14.782722 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:14.783460 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:14.789951 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.790410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.791212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:14.791677 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:14.939103 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:14.946634 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-37a507f2-773e-4694-a811-81f307dc73f8 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1682 microversion: 2.1 time: 0.168105 Jun 03 16:28:14.947200 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 642/1308] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:14 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:15.415813 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:15.416608 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:15.423122 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:15.423684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:15.424462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:15.424910 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:15.558110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:15.566035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:15.567780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:15.568932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-2f9dc80f-92b2-41b5-87bf-6aac47cd6ce1 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.157060 Jun 03 16:28:15.569483 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 667/1309] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:15 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:28:15.963654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:15.964411 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:15.971010 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:15.971495 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:15.972262 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:15.972704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:16.106719 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:16.114463 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ae5ad584-9919-4cbc-a55a-83c1d0a5f167 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1682 microversion: 2.1 time: 0.154637 Jun 03 16:28:16.115040 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 643/1310] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:15 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:16.587906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:16.588601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:16.595390 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:16.595940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:16.596785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:16.597297 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:16.739018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:16.747811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:16.749415 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:16.750646 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ae990218-9cb8-444b-be57-2d6d55beda94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.166631 Jun 03 16:28:16.751570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 668/1311] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:16 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 16:28:17.133005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:17.133464 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:17.140932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:17.141560 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:17.142511 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:17.143009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:17.451932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:17.460458 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e8aaaae8-b843-4112-8588-c734c4405886 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1682 microversion: 2.1 time: 0.332429 Jun 03 16:28:17.460956 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 644/1312] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:17 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1682 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:17.769059 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:17.769900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:17.776389 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:17.776837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:17.777609 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:17.778051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:17.940634 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:17.958900 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-7afa9f88-d055-4c14-b0d7-ebb9d032b867 req-41dea9e0-9dc7-46a7-a298-48d36a5e25b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cd9a4e-635f-422c-86f6-80e40d3f0f43", "name": "network-vif-deleted", "tag": "88e3b07b-0347-4c81-a78d-450830d8f450"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:17.965199 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:17.967463 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94f91ae071b24e31a8ef8d50933ba4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa464e4d2264df68897a6d4b8dc7aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:17.969938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b006c2b2-0763-47cb-871d-3299832875ac tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 200 len: 1722 microversion: 2.20 time: 0.205365 Jun 03 16:28:17.971096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-7afa9f88-d055-4c14-b0d7-ebb9d032b867 req-41dea9e0-9dc7-46a7-a298-48d36a5e25b9 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:17.971767 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-7afa9f88-d055-4c14-b0d7-ebb9d032b867 req-41dea9e0-9dc7-46a7-a298-48d36a5e25b9 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:17.988237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 669/1313] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:17 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 16:28:18.005609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-7afa9f88-d055-4c14-b0d7-ebb9d032b867 req-41dea9e0-9dc7-46a7-a298-48d36a5e25b9 service nova] Creating event network-vif-deleted:88e3b07b-0347-4c81-a78d-450830d8f450 for instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 on hv-cinder-83699 Jun 03 16:28:18.011247 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-7afa9f88-d055-4c14-b0d7-ebb9d032b867 req-41dea9e0-9dc7-46a7-a298-48d36a5e25b9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061694 Jun 03 16:28:18.011873 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 645/1314] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:18.477303 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:18.478028 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:18.487653 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:18.490858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:18.491912 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:18.492655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:18.610276 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:18.611071 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:18.611762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.objects.instance [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lazy-loading 'fault' on Instance uuid 62cd9a4e-635f-422c-86f6-80e40d3f0f43 {{(pid=117571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:28:18.656899 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7c1e449b864b50b3c71c39f19968a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6758d3ab63e4ace8d2d32a4b391d942', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:18.663680 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-65f6dd46-8332-4e0e-b5c6-74e0dad6f0fc tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 200 len: 1330 microversion: 2.1 time: 0.190109 Jun 03 16:28:18.673723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 670/1315] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:18 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:18.993716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:18.995153 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:19.002530 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:19.003190 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:19.004391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:19.005091 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:19.020720 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] HTTP exception thrown: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Request method failure captured: Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 HTTP/1.1 Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO1qJdc5HSPiyGYIbfcQQ53UwGfShPWCjOCw9AKYzOya6O6bldKYqSFi7wvUZwj9r7hsAGThk1EGJlzVSaqaS7hPIFztm5Qpk3GVRrJk_drazfeItq2rGwDfEpczZig9AkQE7NKsTbUWtpB1Amav43aBkzx_9MQbhD_gqUzYhcoodc Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:19.022534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffa464e4d2264df68897a6d4b8dc7aab"}]}] Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 94f91ae071b24e31a8ef8d50933ba4fb Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:19.024078 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '919a4e88-3477-4458-8420-214f2caf16c5'} Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:19.025229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:19.026998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.028341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Returning 404 to user: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:19.028341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5a7fcd95-2404-40ac-9f14-08a69c9b4149 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 404 len: 111 microversion: 2.20 time: 0.037471 Jun 03 16:28:19.028341 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 646/1316] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:18 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:19.035521 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-539b41f1-fda4-4cab-a401-b975386325c2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '.version_select at 0x7fb5c08b9e50>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:19.054985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-539b41f1-fda4-4cab-a401-b975386325c2 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873587406" status: 204 len: 0 microversion: 2.20 time: 0.023688 Jun 03 16:28:19.055686 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 671/1317] 10.222.0.41 () {60 vars in 1258 bytes} [Fri Jun 3 16:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873587406 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 16:28:19.681745 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:19.682522 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:19.689496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:19.689945 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:19.690780 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:19.691217 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:19.706315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 HTTP/1.1 Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:19.707903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:19.709504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '62cd9a4e-635f-422c-86f6-80e40d3f0f43'} Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:19.710354 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:19.711846 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:19.713146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:19.713146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-99dd8448-12bd-4039-877b-c3257b2573da tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 404 len: 111 microversion: 2.1 time: 0.031651 Jun 03 16:28:19.713146 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 647/1318] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:19 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:19.718430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d1bc5c1b-5acc-4219-8ca6-da715f5c3e40 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '.version_select at 0x7fb5c08a3280>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:19.737650 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d1bc5c1b-5acc-4219-8ca6-da715f5c3e40 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107189768" status: 202 len: 0 microversion: 2.1 time: 0.023023 Jun 03 16:28:19.738236 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 672/1319] 10.222.0.41 () {58 vars in 1217 bytes} [Fri Jun 3 16:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107189768 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:28:20.044827 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-a587e7f7-eb52-4e30-88bb-1a03bfe0d575 req-a32c9817-9765-4c07-aa52-f446d3f615e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919a4e88-3477-4458-8420-214f2caf16c5", "name": "network-vif-deleted", "tag": "3113a30d-36af-4d19-891b-9696f04ca42d"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:20.072548 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-a587e7f7-eb52-4e30-88bb-1a03bfe0d575 req-a32c9817-9765-4c07-aa52-f446d3f615e1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:20.073006 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-a587e7f7-eb52-4e30-88bb-1a03bfe0d575 req-a32c9817-9765-4c07-aa52-f446d3f615e1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:20.085260 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-a587e7f7-eb52-4e30-88bb-1a03bfe0d575 req-a32c9817-9765-4c07-aa52-f446d3f615e1 service nova] Creating event network-vif-deleted:3113a30d-36af-4d19-891b-9696f04ca42d for instance 919a4e88-3477-4458-8420-214f2caf16c5 on hv-cinder-83699 Jun 03 16:28:20.090161 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-a587e7f7-eb52-4e30-88bb-1a03bfe0d575 req-a32c9817-9765-4c07-aa52-f446d3f615e1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049115 Jun 03 16:28:20.090746 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 648/1320] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:24.330395 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:24.330896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:24.336820 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.337273 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.338039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.338479 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.351456 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] HTTP exception thrown: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Request method failure captured: Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 HTTP/1.1 Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO1qJdc5HSPiyGYIbfcQQ53UwGfShPWCjOCw9AKYzOya6O6bldKYqSFi7wvUZwj9r7hsAGThk1EGJlzVSaqaS7hPIFztm5Qpk3GVRrJk_drazfeItq2rGwDfEpczZig9AkQE7NKsTbUWtpB1Amav43aBkzx_9MQbhD_gqUzYhcoodc Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:24.353066 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffa464e4d2264df68897a6d4b8dc7aab"}]}] Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 94f91ae071b24e31a8ef8d50933ba4fb Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.354670 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '919a4e88-3477-4458-8420-214f2caf16c5'} Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:24.355451 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.356740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.358021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Returning 404 to user: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:24.358021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5479f380-464d-4763-ad18-ea7452e8d62e tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 404 len: 111 microversion: 2.20 time: 0.029341 Jun 03 16:28:24.358021 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 673/1321] 10.222.0.41 () {60 vars in 1279 bytes} [Fri Jun 3 16:28:24 2022] DELETE /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:24.364421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:24.365164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: 919a4e88-3477-4458-8420-214f2caf16c5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:24.371412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.371866 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.372631 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.373071 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.386595 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] HTTP exception thrown: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Request method failure captured: Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 HTTP/1.1 Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO1qJdc5HSPiyGYIbfcQQ53UwGfShPWCjOCw9AKYzOya6O6bldKYqSFi7wvUZwj9r7hsAGThk1EGJlzVSaqaS7hPIFztm5Qpk3GVRrJk_drazfeItq2rGwDfEpczZig9AkQE7NKsTbUWtpB1Amav43aBkzx_9MQbhD_gqUzYhcoodc Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:24.388211 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffa464e4d2264df68897a6d4b8dc7aab"}]}] Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 94f91ae071b24e31a8ef8d50933ba4fb Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.389984 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '919a4e88-3477-4458-8420-214f2caf16c5'} Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:24.390779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. Jun 03 16:28:24.392105 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.393210 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Returning 404 to user: Instance 919a4e88-3477-4458-8420-214f2caf16c5 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:24.393210 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ed9095c8-2b17-4e8f-8e93-dfd2157905d5 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5" status: 404 len: 111 microversion: 2.20 time: 0.030530 Jun 03 16:28:24.393210 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 649/1322] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:24 2022] GET /compute/v2.1/servers/919a4e88-3477-4458-8420-214f2caf16c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 03 16:28:24.665557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:24.666058 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:24.672008 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.672958 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.673723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.674166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.687128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 HTTP/1.1 Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:24.689406 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.691009 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '62cd9a4e-635f-422c-86f6-80e40d3f0f43'} Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:24.692032 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.693492 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.695013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:24.695013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fb42efac-d792-4502-868d-459cfeb355db tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 404 len: 111 microversion: 2.1 time: 0.029048 Jun 03 16:28:24.695013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 674/1323] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:24 2022] DELETE /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:24.699096 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:24.699733 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 62cd9a4e-635f-422c-86f6-80e40d3f0f43] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:24.705666 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.706109 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.706860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:24.707309 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:24.720741 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 HTTP/1.1 Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:24.722201 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.723796 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '62cd9a4e-635f-422c-86f6-80e40d3f0f43'} Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:24.724601 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. Jun 03 16:28:24.725811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:24.726903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance 62cd9a4e-635f-422c-86f6-80e40d3f0f43 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:24.726903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d8c4ac48-637a-409b-9f5f-68a49d08d582 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43" status: 404 len: 111 microversion: 2.1 time: 0.028451 Jun 03 16:28:24.726903 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 650/1324] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:24 2022] GET /compute/v2.1/servers/62cd9a4e-635f-422c-86f6-80e40d3f0f43 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:25.521594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:25.522098 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:25.528894 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.529349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.530128 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.530572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.543679 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] HTTP exception thrown: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Request method failure captured: Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 HTTP/1.1 Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO1qJdc5HSPiyGYIbfcQQ53UwGfShPWCjOCw9AKYzOya6O6bldKYqSFi7wvUZwj9r7hsAGThk1EGJlzVSaqaS7hPIFztm5Qpk3GVRrJk_drazfeItq2rGwDfEpczZig9AkQE7NKsTbUWtpB1Amav43aBkzx_9MQbhD_gqUzYhcoodc Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:25.545216 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffa464e4d2264df68897a6d4b8dc7aab"}]}] Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 94f91ae071b24e31a8ef8d50933ba4fb Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.546928 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'a565de36-676c-4b81-ae49-3dfadf4dbd06'} Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:25.547873 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.549132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.550730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Returning 404 to user: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:25.550730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-203566e4-e363-4b40-87cf-91acbff9db94 tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 404 len: 111 microversion: 2.20 time: 0.028817 Jun 03 16:28:25.550730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 675/1325] 10.222.0.41 () {60 vars in 1279 bytes} [Fri Jun 3 16:28:25 2022] DELETE /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:25.554679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:25.555311 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] [instance: a565de36-676c-4b81-ae49-3dfadf4dbd06] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:25.561759 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.562212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.563604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.564140 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.579500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] HTTP exception thrown: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Request method failure captured: Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 HTTP/1.1 Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO1qJdc5HSPiyGYIbfcQQ53UwGfShPWCjOCw9AKYzOya6O6bldKYqSFi7wvUZwj9r7hsAGThk1EGJlzVSaqaS7hPIFztm5Qpk3GVRrJk_drazfeItq2rGwDfEpczZig9AkQE7NKsTbUWtpB1Amav43aBkzx_9MQbhD_gqUzYhcoodc Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:25.580998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffa464e4d2264df68897a6d4b8dc7aab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffa464e4d2264df68897a6d4b8dc7aab"}]}] Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: ffa464e4d2264df68897a6d4b8dc7aab Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468799309 Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 94f91ae071b24e31a8ef8d50933ba4fb Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468799309-project Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.582625 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'a565de36-676c-4b81-ae49-3dfadf4dbd06'} Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:25.583563 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. Jun 03 16:28:25.585001 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.586466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] Returning 404 to user: Instance a565de36-676c-4b81-ae49-3dfadf4dbd06 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:25.586466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-767caf3d-a688-4391-a9cb-b8f2fe4ca68c tempest-AttachVolumeShelveTestJSON-1468799309 tempest-AttachVolumeShelveTestJSON-1468799309-project] 10.222.0.41 "GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06" status: 404 len: 111 microversion: 2.20 time: 0.031492 Jun 03 16:28:25.586466 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 651/1326] 10.222.0.41 () {60 vars in 1276 bytes} [Fri Jun 3 16:28:25 2022] GET /compute/v2.1/servers/a565de36-676c-4b81-ae49-3dfadf4dbd06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:25.863549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:25.864039 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:25.870071 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.870520 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.871283 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.871738 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.887270 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e HTTP/1.1 Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:25.888821 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.890317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'cc4c2c92-9f7a-4f64-ba0e-afc94658a59e'} Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:25.891114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.892433 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.893698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:25.893698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6bf897f3-ef6f-4b20-b630-b2c4ae201b51 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 404 len: 111 microversion: 2.1 time: 0.030991 Jun 03 16:28:25.893698 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 676/1327] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:25 2022] DELETE /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:25.898452 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:25.899063 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: cc4c2c92-9f7a-4f64-ba0e-afc94658a59e] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:25.905223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.905608 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.906391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.906824 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.919975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e HTTP/1.1 Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:25.921519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.923914 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'cc4c2c92-9f7a-4f64-ba0e-afc94658a59e'} Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:25.925081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. Jun 03 16:28:25.926534 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.927920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance cc4c2c92-9f7a-4f64-ba0e-afc94658a59e could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:25.927920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-63aa4129-773b-4bc1-baa5-f06539ddbf9d tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e" status: 404 len: 111 microversion: 2.1 time: 0.028700 Jun 03 16:28:25.927920 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 652/1328] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:25 2022] GET /compute/v2.1/servers/cc4c2c92-9f7a-4f64-ba0e-afc94658a59e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:25.933247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:25.933749 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:25.940012 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.940468 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.941851 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.942319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.956801 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 HTTP/1.1 Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:25.958371 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.960002 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '962bba3e-675b-481f-840a-f5d0d2540cb5'} Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:25.963780 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.965234 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.966697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:25.966697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-39c65c0e-2a2e-4fb4-a001-e2edacee9092 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 404 len: 111 microversion: 2.1 time: 0.030385 Jun 03 16:28:25.966697 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 677/1329] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:25 2022] DELETE /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:25.968202 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:25.968792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: 962bba3e-675b-481f-840a-f5d0d2540cb5] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:25.974770 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.975214 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.976015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:25.977157 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:25.990834 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 HTTP/1.1 Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:25.992416 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.993907 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '962bba3e-675b-481f-840a-f5d0d2540cb5'} Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:25.994646 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. Jun 03 16:28:25.995891 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:25.997321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance 962bba3e-675b-481f-840a-f5d0d2540cb5 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:25.997321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-af44b719-e845-4b91-96cb-bc802e4a540a tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5" status: 404 len: 111 microversion: 2.1 time: 0.029429 Jun 03 16:28:25.997321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 653/1330] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:25 2022] GET /compute/v2.1/servers/962bba3e-675b-481f-840a-f5d0d2540cb5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:27.134306 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:27.134865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:27.144017 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:27.144616 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:27.145539 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:27.146069 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:27.165439 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 HTTP/1.1 Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:27.167392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.169016 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'aab42cfc-29a0-4c3f-b30b-e5902d661dd2'} Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:27.169938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.171351 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.173113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:27.173113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0cc058bc-e89c-45cf-9bb5-d7121443af92 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 404 len: 111 microversion: 2.1 time: 0.039254 Jun 03 16:28:27.173113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 678/1331] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:27 2022] DELETE /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:27.179805 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:27.180512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] [instance: aab42cfc-29a0-4c3f-b30b-e5902d661dd2] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:27.189862 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:27.191194 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:27.196325 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:27.196859 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:27.212055 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] HTTP exception thrown: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Request method failure captured: Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 HTTP/1.1 Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjO36ybiNHApjHL3ZVPRG3IFoYyb3vX8pK03kOalxbwoMtjtOolgZFeLc96WLtGjh4GGk0f7Lcb4nMJFIFUQBn_5Coo1HIl8dOL-nm36ii_Zrp8Oz3bZvLhiXs0pB_WY9rD6ogxMKqAIeEIZ_Z_yurvoqHJM-T3DS4VkdQlmmY0c-2M Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:27.214331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6758d3ab63e4ace8d2d32a4b391d942"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6758d3ab63e4ace8d2d32a4b391d942"}]}] Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: c6758d3ab63e4ace8d2d32a4b391d942 Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1507989591 Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: ef7c1e449b864b50b3c71c39f19968a0 Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-AttachVolumeNegativeTest-1507989591-project Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.215751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'aab42cfc-29a0-4c3f-b30b-e5902d661dd2'} Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:27.216512 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. Jun 03 16:28:27.217774 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:27.220425 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] Returning 404 to user: Instance aab42cfc-29a0-4c3f-b30b-e5902d661dd2 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:27.222742 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-1ef7e652-325b-4c78-8824-d6d6bd486b34 tempest-AttachVolumeNegativeTest-1507989591 tempest-AttachVolumeNegativeTest-1507989591-project] 10.222.0.41 "GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2" status: 404 len: 111 microversion: 2.1 time: 0.047993 Jun 03 16:28:27.229352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 654/1332] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:27 2022] GET /compute/v2.1/servers/aab42cfc-29a0-4c3f-b30b-e5902d661dd2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:30.781069 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-98e25804-410f-4a50-a2e5-fc00120c0b5e tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Action: 'create', calling method: .version_select at 0x7fb5c5cac700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-744627912", "metadata": {"Type": "work"}}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-98e25804-410f-4a50-a2e5-fc00120c0b5e tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Request method failure captured: Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 121 Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjauAmSpX9G7sxs1Aqsh3pAMYJy0KcX6NmVVvU-5hy0jwysfGqDKp8mVDzRXLzsVhNP8SJNHO1riuG3ubY_WYlouNl3QRqF5f8ITnaYnaDTsT2TDCxK0o5l5gXhbkfGadhYLCVLLG02MT7Z8f89lTSMzw7Uk6559rE_mDxCLabaLr4o Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:30.798458 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6dd01e60a8c74079ae95475fdd080bbf"}]}] Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 956771cacbd849a2b87bdc5048105bae Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-744627912", "metadata": {"Type": "work"}}} Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: Jun 03 16:28:30.800001 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-744627912', 'metadata': {'Type': 'work'}}}} Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise error Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:30.800950 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 16:28:30.802401 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 16:28:30.803651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 16:28:30.803651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.803651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-98e25804-410f-4a50-a2e5-fc00120c0b5e tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:30.803651 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-98e25804-410f-4a50-a2e5-fc00120c0b5e tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.192347 Jun 03 16:28:30.807648 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 679/1333] 10.222.0.41 () {60 vars in 1155 bytes} [Fri Jun 3 16:28:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:30.814294 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fd9acc3a-a38c-422d-bda9-d0fc3264547f tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Action: 'create', calling method: .version_select at 0x7fb5c09e80d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1622595952", "metadata": {"Type": "work"}}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fd9acc3a-a38c-422d-bda9-d0fc3264547f tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Request method failure captured: Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 120 Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjauAmSpX9G7sxs1Aqsh3pAMYJy0KcX6NmVVvU-5hy0jwysfGqDKp8mVDzRXLzsVhNP8SJNHO1riuG3ubY_WYlouNl3QRqF5f8ITnaYnaDTsT2TDCxK0o5l5gXhbkfGadhYLCVLLG02MT7Z8f89lTSMzw7Uk6559rE_mDxCLabaLr4o Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:30.818472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6dd01e60a8c74079ae95475fdd080bbf"}]}] Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 956771cacbd849a2b87bdc5048105bae Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1622595952", "metadata": {"Type": "work"}}} Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: Jun 03 16:28:30.819970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1622595952', 'metadata': {'Type': 'work'}}}} Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise error Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi '0' Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:30.820998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 16:28:30.828203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 16:28:30.830499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 16:28:30.830499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.830499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-fd9acc3a-a38c-422d-bda9-d0fc3264547f tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:30.830499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-fd9acc3a-a38c-422d-bda9-d0fc3264547f tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010858 Jun 03 16:28:30.830499 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 655/1334] 10.222.0.41 () {60 vars in 1155 bytes} [Fri Jun 3 16:28:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:30.836836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bbe03356-4c85-448d-9dbc-d933c691ce96 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Action: 'create', calling method: .version_select at 0x7fb5c5e0fb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1663370932", "metadata": {"Type": "work"}}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bbe03356-4c85-448d-9dbc-d933c691ce96 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Request method failure captured: Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 119 Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjauAmSpX9G7sxs1Aqsh3pAMYJy0KcX6NmVVvU-5hy0jwysfGqDKp8mVDzRXLzsVhNP8SJNHO1riuG3ubY_WYlouNl3QRqF5f8ITnaYnaDTsT2TDCxK0o5l5gXhbkfGadhYLCVLLG02MT7Z8f89lTSMzw7Uk6559rE_mDxCLabaLr4o Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:30.839238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6dd01e60a8c74079ae95475fdd080bbf"}]}] Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 956771cacbd849a2b87bdc5048105bae Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1663370932", "metadata": {"Type": "work"}}} Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: Jun 03 16:28:30.840878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1663370932', 'metadata': {'Type': 'work'}}}} Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise error Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi '' Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:30.846561 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 16:28:30.848212 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 16:28:30.849730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 16:28:30.849730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.849730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bbe03356-4c85-448d-9dbc-d933c691ce96 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:30.849730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bbe03356-4c85-448d-9dbc-d933c691ce96 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012484 Jun 03 16:28:30.849730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 680/1335] 10.222.0.41 () {60 vars in 1155 bytes} [Fri Jun 3 16:28:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 16:28:30.851352 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3aa6d38b-e5cc-4d39-a04a-d7b22763b1f5 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Calling method '.version_select at 0x7fb5c0a43940>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:30.884732 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-3aa6d38b-e5cc-4d39-a04a-d7b22763b1f5 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] HTTP exception thrown: Volume tempest-invalid-1987403117 could not be found. Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3aa6d38b-e5cc-4d39-a04a-d7b22763b1f5 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Request method failure captured: Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1987403117 HTTP/1.1 Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjauAmSpX9G7sxs1Aqsh3pAMYJy0KcX6NmVVvU-5hy0jwysfGqDKp8mVDzRXLzsVhNP8SJNHO1riuG3ubY_WYlouNl3QRqF5f8ITnaYnaDTsT2TDCxK0o5l5gXhbkfGadhYLCVLLG02MT7Z8f89lTSMzw7Uk6559rE_mDxCLabaLr4o Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:30.888007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6dd01e60a8c74079ae95475fdd080bbf"}]}] Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 956771cacbd849a2b87bdc5048105bae Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Volume tempest-invalid-1987403117 could not be found. Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'tempest-invalid-1987403117'} Jun 03 16:28:30.889678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1987403117 could not be found. (HTTP 404) (Request-ID: req-26cfe4a1-e91d-476c-b962-97e8460b73b8) Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.890968 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 16:28:30.893138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1987403117 could not be found. Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:30.895015 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1987403117 could not be found. Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1987403117 could not be found. Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3aa6d38b-e5cc-4d39-a04a-d7b22763b1f5 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Returning 404 to user: Volume tempest-invalid-1987403117 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3aa6d38b-e5cc-4d39-a04a-d7b22763b1f5 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1987403117" status: 404 len: 99 microversion: 2.1 time: 0.042793 Jun 03 16:28:30.896688 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 656/1336] 10.222.0.41 () {58 vars in 1217 bytes} [Fri Jun 3 16:28:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1987403117 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 03 16:28:30.904316 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-629c9a94-d6f5-444d-a4b4-6ed954a850f6 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004993 Jun 03 16:28:30.904932 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 681/1337] 10.222.0.41 () {58 vars in 1139 bytes} [Fri Jun 3 16:28:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 16:28:30.918011 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-370466e4-0836-4bf2-811f-799db79517dd tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004590 Jun 03 16:28:30.918810 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 657/1338] 10.222.0.41 () {58 vars in 1136 bytes} [Fri Jun 3 16:28:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 16:28:30.928781 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4a29a8f6-635c-46d2-8758-feb3c40a8651 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Calling method '.version_select at 0x7fb5c0e5d310>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:30.972551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-4a29a8f6-635c-46d2-8758-feb3c40a8651 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] HTTP exception thrown: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4a29a8f6-635c-46d2-8758-feb3c40a8651 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Request method failure captured: Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/os-volumes/4412dd05-ef53-44bf-ab6a-d36894713ff6 HTTP/1.1 Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjauAmSpX9G7sxs1Aqsh3pAMYJy0KcX6NmVVvU-5hy0jwysfGqDKp8mVDzRXLzsVhNP8SJNHO1riuG3ubY_WYlouNl3QRqF5f8ITnaYnaDTsT2TDCxK0o5l5gXhbkfGadhYLCVLLG02MT7Z8f89lTSMzw7Uk6559rE_mDxCLabaLr4o Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:30.975600 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6dd01e60a8c74079ae95475fdd080bbf"}]}] Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 956771cacbd849a2b87bdc5048105bae Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '4412dd05-ef53-44bf-ab6a-d36894713ff6'} Jun 03 16:28:30.977208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. (HTTP 404) (Request-ID: req-7fbd36db-e39f-4c2e-96ff-6d0c5cdd1743) Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.978288 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 16:28:30.979739 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 16:28:30.980891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-4a29a8f6-635c-46d2-8758-feb3c40a8651 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Returning 404 to user: Volume 4412dd05-ef53-44bf-ab6a-d36894713ff6 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-4a29a8f6-635c-46d2-8758-feb3c40a8651 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/4412dd05-ef53-44bf-ab6a-d36894713ff6" status: 404 len: 109 microversion: 2.1 time: 0.052137 Jun 03 16:28:30.982366 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 682/1339] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:28:30 2022] DELETE /compute/v2.1/os-volumes/4412dd05-ef53-44bf-ab6a-d36894713ff6 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:30.988552 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e795ca6b-a47d-4da3-8a38-9355177f3102 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Calling method '.version_select at 0x7fb5c5ee0c10>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:31.021321 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-e795ca6b-a47d-4da3-8a38-9355177f3102 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] HTTP exception thrown: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e795ca6b-a47d-4da3-8a38-9355177f3102 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Request method failure captured: Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/os-volumes/c1b6f957-ab0f-4324-8835-78e4cea16271 HTTP/1.1 Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjauAmSpX9G7sxs1Aqsh3pAMYJy0KcX6NmVVvU-5hy0jwysfGqDKp8mVDzRXLzsVhNP8SJNHO1riuG3ubY_WYlouNl3QRqF5f8ITnaYnaDTsT2TDCxK0o5l5gXhbkfGadhYLCVLLG02MT7Z8f89lTSMzw7Uk6559rE_mDxCLabaLr4o Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:28:31.023267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6dd01e60a8c74079ae95475fdd080bbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6dd01e60a8c74079ae95475fdd080bbf"}]}] Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 6dd01e60a8c74079ae95475fdd080bbf Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-VolumesNegativeTest-633796493 Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 956771cacbd849a2b87bdc5048105bae Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-VolumesNegativeTest-633796493-project Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'c1b6f957-ab0f-4324-8835-78e4cea16271'} Jun 03 16:28:31.024994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. (HTTP 404) (Request-ID: req-588a6967-d05b-4f60-90dd-b7a9666c462d) Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:31.034307 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:28:31.035819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 16:28:31.037565 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e795ca6b-a47d-4da3-8a38-9355177f3102 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] Returning 404 to user: Volume c1b6f957-ab0f-4324-8835-78e4cea16271 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e795ca6b-a47d-4da3-8a38-9355177f3102 tempest-VolumesNegativeTest-633796493 tempest-VolumesNegativeTest-633796493-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c1b6f957-ab0f-4324-8835-78e4cea16271" status: 404 len: 109 microversion: 2.1 time: 0.040240 Jun 03 16:28:31.039004 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 658/1340] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:28:30 2022] GET /compute/v2.1/os-volumes/c1b6f957-ab0f-4324-8835-78e4cea16271 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:33.454589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bfcac0cf-7235-49f1-9144-fe89b279e3a3 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Action: 'create', calling method: .version_select at 0x7fb5c08b7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-506895586", "metadata": {"Type": "work"}}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:33.788271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bfcac0cf-7235-49f1-9144-fe89b279e3a3 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.599895 Jun 03 16:28:33.788891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 683/1341] 10.222.0.41 () {60 vars in 1155 bytes} [Fri Jun 3 16:28:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 601 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 16:28:33.801124 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c3c34efe-2f4e-4eb2-aeb7-7b5a7fe451d3 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Calling method '.version_select at 0x7fb5c0a8fc10>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:33.859706 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c3c34efe-2f4e-4eb2-aeb7-7b5a7fe451d3 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15" status: 200 len: 352 microversion: 2.1 time: 0.063530 Jun 03 16:28:33.860725 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 659/1342] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:28:33 2022] GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:34.873627 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e2f6d40f-acb6-4432-9738-73bb2b1aeb5d tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Calling method '.version_select at 0x7fb5c08b4550>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:34.928167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e2f6d40f-acb6-4432-9738-73bb2b1aeb5d tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15" status: 200 len: 353 microversion: 2.1 time: 0.059697 Jun 03 16:28:34.928752 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 684/1343] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:28:34 2022] GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:34.940164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-b07fb87b-1e1e-4e85-ae28-154d27e12bcd tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Calling method '.version_select at 0x7fb5c5ee01f0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:34.985805 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-b07fb87b-1e1e-4e85-ae28-154d27e12bcd tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15" status: 200 len: 353 microversion: 2.1 time: 0.050035 Jun 03 16:28:34.986375 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 660/1344] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:28:34 2022] GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:35.001731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-bfa663a9-6281-44e0-b0b7-2113884c2e85 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Calling method '.version_select at 0x7fb5c5cac670>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:35.059989 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-bfa663a9-6281-44e0-b0b7-2113884c2e85 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15" status: 202 len: 0 microversion: 2.1 time: 0.062027 Jun 03 16:28:35.060570 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 685/1345] 10.222.0.41 () {58 vars in 1247 bytes} [Fri Jun 3 16:28:34 2022] DELETE /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 16:28:35.068520 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-d374acc1-82d8-43f5-99b7-18e25cf2efb2 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Calling method '.version_select at 0x7fb5c5ed7ca0>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:35.115209 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-d374acc1-82d8-43f5-99b7-18e25cf2efb2 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15" status: 200 len: 352 microversion: 2.1 time: 0.050417 Jun 03 16:28:35.115754 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 661/1346] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:28:35 2022] GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:36.129730 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d13e7416-9a17-4dc1-8115-7070c01474c9 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Calling method '.version_select at 0x7fb5c08b9f70>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:36.157507 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-d13e7416-9a17-4dc1-8115-7070c01474c9 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] HTTP exception thrown: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d13e7416-9a17-4dc1-8115-7070c01474c9 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Request method failure captured: Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 HTTP/1.1 Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjaxbB7_GagPNHxXkI0Vc6qBuqDhFDkND6oP_uWG8k9-wDf8LrsyNXJgJI2La1Q-FELE1_-mQo-0RzRxax59Lo7CI2p2v2XVeWp1X9cB6u0iXUyBjmE5DCzAFn654LdfIEaFCRZTnJncxicyM2Wnkq0fu_hAkowpoUuUJ3w8FzOMBZk Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 6b68fed95706473cb2c06c72558da3e2 Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-VolumesGetTestJSON-468609324 Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:36.159494 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6b68fed95706473cb2c06c72558da3e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/6b68fed95706473cb2c06c72558da3e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/6b68fed95706473cb2c06c72558da3e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_6b68fed95706473cb2c06c72558da3e2"}]}] Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-VolumesGetTestJSON-468609324 Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 6b68fed95706473cb2c06c72558da3e2 Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-VolumesGetTestJSON-468609324 Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-VolumesGetTestJSON-468609324-project Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 06dc59a28a4a4709909054470058064a Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-VolumesGetTestJSON-468609324-project Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': 'c3822eb7-cc81-428a-a6f6-e14be0e8de15'} Jun 03 16:28:36.161109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. (HTTP 404) (Request-ID: req-afedbc6d-c285-41e9-b70d-7fe7cb080e6e) Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:36.162118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 16:28:36.163537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 16:28:36.165309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d13e7416-9a17-4dc1-8115-7070c01474c9 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] Returning 404 to user: Volume c3822eb7-cc81-428a-a6f6-e14be0e8de15 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d13e7416-9a17-4dc1-8115-7070c01474c9 tempest-VolumesGetTestJSON-468609324 tempest-VolumesGetTestJSON-468609324-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15" status: 404 len: 109 microversion: 2.1 time: 0.036994 Jun 03 16:28:36.166731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 686/1347] 10.222.0.41 () {58 vars in 1244 bytes} [Fri Jun 3 16:28:36 2022] GET /compute/v2.1/os-volumes/c3822eb7-cc81-428a-a6f6-e14be0e8de15 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:50.142880 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:50.145317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:50.146158 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:50.146930 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:50.158250 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:50.160179 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:28:50.167031 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:50.168219 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:50.169519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:50.170592 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:50.215965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:28:50.363913 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-0243f9ff-7109-4efd-8e2c-319ea01aaec9 req-5f71c984-31f6-441a-ab02-cdacdc7ee8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256059e7-995a-4b7d-9439-f32447aca406", "tag": "81c8deba-9996-499e-b7d9-9e60b5cf128c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:50.380149 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e93f5e8f-8ed7-4610-ad46-12fb128c324e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "DELETE /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 204 len: 0 microversion: 2.1 time: 0.243543 Jun 03 16:28:50.381237 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-0243f9ff-7109-4efd-8e2c-319ea01aaec9 req-5f71c984-31f6-441a-ab02-cdacdc7ee8c1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:50.381503 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 662/1348] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:50 2022] DELETE /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:28:50.384671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-0243f9ff-7109-4efd-8e2c-319ea01aaec9 req-5f71c984-31f6-441a-ab02-cdacdc7ee8c1 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:50.399531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:50.399531 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:50.409477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:50.410325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-0243f9ff-7109-4efd-8e2c-319ea01aaec9 req-5f71c984-31f6-441a-ab02-cdacdc7ee8c1 service nova] Creating event network-changed:81c8deba-9996-499e-b7d9-9e60b5cf128c for instance 256059e7-995a-4b7d-9439-f32447aca406 on hv-cinder-83699 Jun 03 16:28:50.411276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:50.412114 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:50.412567 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:50.421756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-0243f9ff-7109-4efd-8e2c-319ea01aaec9 req-5f71c984-31f6-441a-ab02-cdacdc7ee8c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282204 Jun 03 16:28:50.422593 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 687/1349] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:28:50.566819 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:50.574661 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f5b4a530-af5b-4c85-a768-8c3999e3a5a2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1578 microversion: 2.1 time: 0.186576 Jun 03 16:28:50.575248 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 663/1350] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:50 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:51.596159 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:51.596854 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:51.603525 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:51.603977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:51.604880 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:51.605318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:51.742964 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:51.750881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-86189fff-fbce-4d07-a2d4-620e837faf71 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1578 microversion: 2.1 time: 0.159652 Jun 03 16:28:51.751667 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 688/1351] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:51 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:52.768337 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:52.769477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:52.780240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:52.780698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:52.781485 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:52.781994 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:52.870127 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:52.878703 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c92b69fb-4007-42c9-898d-1c6735bae188 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1392 microversion: 2.1 time: 0.114322 Jun 03 16:28:52.879470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 664/1352] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:52 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1392 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:52.929982 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-56599c40-78e8-4983-b73f-8bdecd926d8a req-a43cf3bd-be24-4340-a957-63c002eea4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256059e7-995a-4b7d-9439-f32447aca406", "name": "network-vif-deleted", "tag": "81c8deba-9996-499e-b7d9-9e60b5cf128c"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:52.940381 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-56599c40-78e8-4983-b73f-8bdecd926d8a req-a43cf3bd-be24-4340-a957-63c002eea4ab service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:52.941114 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-56599c40-78e8-4983-b73f-8bdecd926d8a req-a43cf3bd-be24-4340-a957-63c002eea4ab service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:52.952533 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-56599c40-78e8-4983-b73f-8bdecd926d8a req-a43cf3bd-be24-4340-a957-63c002eea4ab service nova] Creating event network-vif-deleted:81c8deba-9996-499e-b7d9-9e60b5cf128c for instance 256059e7-995a-4b7d-9439-f32447aca406 on hv-cinder-83699 Jun 03 16:28:52.957325 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-56599c40-78e8-4983-b73f-8bdecd926d8a req-a43cf3bd-be24-4340-a957-63c002eea4ab service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Jun 03 16:28:52.957953 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 689/1353] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:53.898080 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:53.898866 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:53.907074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:53.907879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:53.908656 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:53.909099 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:53.944817 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:53.945281 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:53.946138 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lazy-loading 'fault' on Instance uuid 256059e7-995a-4b7d-9439-f32447aca406 {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:28:53.998777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:54.007403 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e3aad525-1597-4b47-be50-1e4d6a28ad22 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 200 len: 1184 microversion: 2.1 time: 0.116190 Jun 03 16:28:54.008206 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 665/1354] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:53 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 1184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:55.025088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:55.025789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 256059e7-995a-4b7d-9439-f32447aca406] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:55.035652 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:55.036397 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:55.037317 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:55.037762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:55.051466 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] HTTP exception thrown: Instance 256059e7-995a-4b7d-9439-f32447aca406 could not be found. Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Request method failure captured: Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 HTTP/1.1 Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjRShUfHIjbndzvv9_4tpszxRzIg6BVt0HriYVhkAKwmKIhNIlEgSgecw4b-qPNqHevfcYhZ6ygRw7N2wBXMl61tpxn0JxnoiUZfk_gVMEqyJRymNhgJFlN2MBZEx77-6qWs8K25B_-SGKgRRW7Fv_yzQ7BhXfvDUayb-zzwwzutFgk Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:28:55.053113 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7d586c0c8dd34398af9d52425eb2bde3"}]}] Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 331c97a12f1b4c2eb1eefa61056ce089 Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 256059e7-995a-4b7d-9439-f32447aca406 could not be found. Jun 03 16:28:55.054796 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '256059e7-995a-4b7d-9439-f32447aca406'} Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 256059e7-995a-4b7d-9439-f32447aca406 could not be found. Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:28:55.055770 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 256059e7-995a-4b7d-9439-f32447aca406 could not be found. Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 256059e7-995a-4b7d-9439-f32447aca406 could not be found. Jun 03 16:28:55.057267 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:28:55.059782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Returning 404 to user: Instance 256059e7-995a-4b7d-9439-f32447aca406 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:28:55.060822 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a9c4a864-9816-4b05-9a0f-19096b3d0cd8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406" status: 404 len: 111 microversion: 2.1 time: 0.040466 Jun 03 16:28:55.065768 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 690/1355] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:55 2022] GET /compute/v2.1/servers/256059e7-995a-4b7d-9439-f32447aca406 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:28:58.382627 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:58.383122 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:58.385298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-39f199a3-9c45-408d-9d0f-19027ec205ce req-193015ee-4c76-4298-adf7-ef3910ba200f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0", "tag": "e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:28:58.389793 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:58.390331 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:58.391111 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:58.391642 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:58.395871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-39f199a3-9c45-408d-9d0f-19027ec205ce req-193015ee-4c76-4298-adf7-ef3910ba200f service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:58.396428 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-39f199a3-9c45-408d-9d0f-19027ec205ce req-193015ee-4c76-4298-adf7-ef3910ba200f service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:58.408110 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-39f199a3-9c45-408d-9d0f-19027ec205ce req-193015ee-4c76-4298-adf7-ef3910ba200f service nova] Creating event network-changed:e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1 for instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 on hv-cinder-83699 Jun 03 16:28:58.413261 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-39f199a3-9c45-408d-9d0f-19027ec205ce req-193015ee-4c76-4298-adf7-ef3910ba200f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Jun 03 16:28:58.413846 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 691/1356] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:28:58.421014 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:28:58.502752 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-447ca77c-2733-45e7-945b-6cc9ec36ef55 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 204 len: 0 microversion: 2.1 time: 0.123228 Jun 03 16:28:58.506497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 666/1357] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:28:58 2022] DELETE /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:28:58.515063 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:58.515795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:58.522538 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:58.524264 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:58.525723 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:58.526477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:58.677372 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:58.686109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c061baed-d184-4519-91a4-2417c31ceb2d tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1574 microversion: 2.1 time: 0.176725 Jun 03 16:28:58.687233 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 692/1358] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:58 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:28:59.705431 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:28:59.706144 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:28:59.713012 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:59.713541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:59.714494 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:28:59.714998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:28:59.858194 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:28:59.865998 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7af8fa6d-434e-4c2b-b644-4102eae6afa3 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1574 microversion: 2.1 time: 0.165415 Jun 03 16:28:59.866651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 667/1359] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:28:59 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 16:29:00.883249 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:00.883911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:00.890764 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:00.891209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:00.892023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:00.892946 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:01.033845 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:01.041467 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-52ae6f49-c9f6-4db2-a8c2-48619d2ba112 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1574 microversion: 2.1 time: 0.162225 Jun 03 16:29:01.042041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 693/1360] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:00 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:02.057989 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:02.058542 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:02.065095 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:02.065541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:02.066304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:02.066736 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:02.197538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:02.205693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-142373ed-5fea-4dbb-8a94-e571d0c02233 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1574 microversion: 2.1 time: 0.151559 Jun 03 16:29:02.206406 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 668/1361] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:02 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:03.221981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:03.222596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:03.229202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:03.229662 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:03.230445 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:03.230891 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:03.365454 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:03.372881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b91811a8-e383-4a93-83a7-f9e45a655127 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1457 microversion: 2.1 time: 0.154815 Jun 03 16:29:03.373443 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 694/1362] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:03 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1457 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:04.389158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:04.389782 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:04.396885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:04.397336 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:04.398106 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:04.398551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:04.523807 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:04.531540 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-893943b6-b013-4116-b2fe-185426aac1b9 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1457 microversion: 2.1 time: 0.146232 Jun 03 16:29:04.532106 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 669/1363] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:04 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1457 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:05.547309 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:05.547923 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:05.554120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:05.554569 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:05.555349 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:05.555790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:05.679878 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:05.687207 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-f5566826-0bc2-48cd-82cb-7041f784bf84 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1457 microversion: 2.1 time: 0.143740 Jun 03 16:29:05.687795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 695/1364] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:05 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1457 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:06.544934 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-93b88b8f-73c1-472c-bf38-aec3b3a58137 req-651cf4f0-8762-4a00-a531-2d5f41268735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0", "name": "network-vif-deleted", "tag": "e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:29:06.555424 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-93b88b8f-73c1-472c-bf38-aec3b3a58137 req-651cf4f0-8762-4a00-a531-2d5f41268735 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:06.555980 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-93b88b8f-73c1-472c-bf38-aec3b3a58137 req-651cf4f0-8762-4a00-a531-2d5f41268735 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:06.569437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-93b88b8f-73c1-472c-bf38-aec3b3a58137 req-651cf4f0-8762-4a00-a531-2d5f41268735 service nova] Creating event network-vif-deleted:e256fc3c-4ba3-46c1-bd56-78cb3f6d50c1 for instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 on hv-cinder-83699 Jun 03 16:29:06.574484 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-93b88b8f-73c1-472c-bf38-aec3b3a58137 req-651cf4f0-8762-4a00-a531-2d5f41268735 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 Jun 03 16:29:06.575134 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 670/1365] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:29:06.704760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:06.705926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:06.712384 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:06.712791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:06.713584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:06.713994 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:06.774171 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:06.781870 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-243e7657-9961-409e-aead-8799f63d6aeb tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1224 microversion: 2.1 time: 0.080937 Jun 03 16:29:06.782462 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 696/1366] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:06 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:06.843007 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:29:06.843435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:29:07.800886 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:07.801486 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:07.807609 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:07.808054 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:07.808804 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:07.809236 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:07.870440 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:07.877853 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-ddc2ebf8-c506-4acb-b523-5782bc5ae399 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1224 microversion: 2.1 time: 0.082166 Jun 03 16:29:07.878407 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 671/1367] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:07 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:08.894906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:08.895551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:08.902319 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:08.902779 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:08.903578 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:08.904023 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:08.965374 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:08.973064 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b49d8347-9973-4d66-bd61-9d6424da2bb5 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1224 microversion: 2.1 time: 0.082666 Jun 03 16:29:08.974532 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 697/1368] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:08 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:09.989894 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:09.990517 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:09.997028 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:09.997473 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:09.998223 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:09.998652 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:10.061045 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:10.069193 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-4a185ed5-d1e7-4a5b-84ee-845391a65916 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1224 microversion: 2.1 time: 0.083190 Jun 03 16:29:10.069743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 672/1369] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:09 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:11.085924 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:11.086534 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:11.093509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:11.093990 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:11.094762 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:11.095196 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:11.160523 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c97a12f1b4c2eb1eefa61056ce089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d586c0c8dd34398af9d52425eb2bde3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:29:11.168036 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-321a7f17-c392-4fba-8fed-d13d5e76184e tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 200 len: 1224 microversion: 2.1 time: 0.085860 Jun 03 16:29:11.168589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 698/1370] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:11 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:29:12.185121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:12.185751 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:12.193093 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:12.193545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:12.194329 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:12.194771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:12.208067 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] HTTP exception thrown: Instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 could not be found. Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Request method failure captured: Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 HTTP/1.1 Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjRShUfHIjbndzvv9_4tpszxRzIg6BVt0HriYVhkAKwmKIhNIlEgSgecw4b-qPNqHevfcYhZ6ygRw7N2wBXMl61tpxn0JxnoiUZfk_gVMEqyJRymNhgJFlN2MBZEx77-6qWs8K25B_-SGKgRRW7Fv_yzQ7BhXfvDUayb-zzwwzutFgk Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:29:12.209743 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7d586c0c8dd34398af9d52425eb2bde3"}]}] Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 331c97a12f1b4c2eb1eefa61056ce089 Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 could not be found. Jun 03 16:29:12.211412 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': 'fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0'} Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 could not be found. Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:29:12.212246 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 could not be found. Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 could not be found. Jun 03 16:29:12.213524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.215477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Returning 404 to user: Instance fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:29:12.215477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-05031d32-2ac6-4a45-b78b-af75005fb0e7 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0" status: 404 len: 111 microversion: 2.1 time: 0.030138 Jun 03 16:29:12.215477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 673/1371] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:12 2022] GET /compute/v2.1/servers/fbdf4bb9-f506-40e7-b4ce-c4b6c3cb77f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:29:12.669266 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:12.669813 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:12.676509 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:12.676965 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:12.677742 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:12.678184 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:12.692025 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] HTTP exception thrown: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Request method failure captured: Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: DELETE /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 HTTP/1.1 Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjRShUfHIjbndzvv9_4tpszxRzIg6BVt0HriYVhkAKwmKIhNIlEgSgecw4b-qPNqHevfcYhZ6ygRw7N2wBXMl61tpxn0JxnoiUZfk_gVMEqyJRymNhgJFlN2MBZEx77-6qWs8K25B_-SGKgRRW7Fv_yzQ7BhXfvDUayb-zzwwzutFgk Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:29:12.693771 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7d586c0c8dd34398af9d52425eb2bde3"}]}] Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: 331c97a12f1b4c2eb1eefa61056ce089 Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.695551 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '7ea2cd56-026c-4b2e-a39a-35bc5db65f46'} Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:29:12.696470 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.697985 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.699549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Returning 404 to user: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:29:12.699549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-93235438-2472-47af-bf69-5c9cc3772ba2 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 404 len: 111 microversion: 2.1 time: 0.029720 Jun 03 16:29:12.699549 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 699/1372] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:29:12 2022] DELETE /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:29:12.704739 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:12.705432 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] [instance: 7ea2cd56-026c-4b2e-a39a-35bc5db65f46] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:29:12.711573 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:12.712024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:12.712799 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:29:12.713624 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:29:12.727901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.wsgi [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] HTTP exception thrown: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Request method failure captured: Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: request: GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 HTTP/1.1 Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept: application/json Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Accept-Encoding: identity Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Connection: close Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Length: 0 Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Content-Type: application/json Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Host: 10.222.0.41 Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Openstack-System-Scope: None Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: User-Agent: python-urllib3/1.26.9 Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Auth-Token: gAAAAABimjRShUfHIjbndzvv9_4tpszxRzIg6BVt0HriYVhkAKwmKIhNIlEgSgecw4b-qPNqHevfcYhZ6ygRw7N2wBXMl61tpxn0JxnoiUZfk_gVMEqyJRymNhgJFlN2MBZEx77-6qWs8K25B_-SGKgRRW7Fv_yzQ7BhXfvDUayb-zzwwzutFgk Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Id: None Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Domain-Name: None Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Identity-Status: Confirmed Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Is-Admin-Project: True Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Id: default Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Domain-Name: Default Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Project-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Role: member,reader Jun 03 16:29:12.729421 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Roles: member,reader Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7d586c0c8dd34398af9d52425eb2bde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7d586c0c8dd34398af9d52425eb2bde3"}]}] Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Id: 7d586c0c8dd34398af9d52425eb2bde3 Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-Tenant-Name: tempest-TestVolumeBootPattern-2007408805 Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Id: default Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Domain-Name: Default Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Id: 331c97a12f1b4c2eb1eefa61056ce089 Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: X-User-Name: tempest-TestVolumeBootPattern-2007408805-project Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: method: > Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: exception: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.731029 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: action_args: {'id': '7ea2cd56-026c-4b2e-a39a-35bc5db65f46'} Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:29:12.731915 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. Jun 03 16:29:12.733400 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR nova.api.openstack.wsgi Jun 03 16:29:12.735365 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Returning 404 to user: Instance 7ea2cd56-026c-4b2e-a39a-35bc5db65f46 could not be found. {{(pid=117570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:29:12.736207 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-f64d241b-377e-4091-92bb-4e253258d9d8 tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46" status: 404 len: 111 microversion: 2.1 time: 0.035439 Jun 03 16:29:12.737306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 674/1373] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:29:12 2022] GET /compute/v2.1/servers/7ea2cd56-026c-4b2e-a39a-35bc5db65f46 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:29:14.055791 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fd36e9a3-25f0-45d4-9a0f-42acb194e5ef tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] Calling method '.version_select at 0x7fb5c5cac790>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:29:14.076597 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fd36e9a3-25f0-45d4-9a0f-42acb194e5ef tempest-TestVolumeBootPattern-2007408805 tempest-TestVolumeBootPattern-2007408805-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-540010629" status: 202 len: 0 microversion: 2.1 time: 0.024310 Jun 03 16:29:14.077464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 700/1374] 10.222.0.41 () {58 vars in 1259 bytes} [Fri Jun 3 16:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-540010629 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:29:26.566166 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:29:26.566911 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:29:43.631622 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:43.632551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:29:43.799965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-920eeafe-0c64-4258-971f-7255bbd85763 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Action: 'create', calling method: .version_select at 0x7fb5c5e888b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1954646034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOolWchYfm78v+JkRQWlLtknL6ePtCX+mKMPL+EjLAVsZStmnSbIoZBOUY28jMYmdu67TaO9d5Ok4DgVD7aiuuYsgXC8CruNYdzw1D4VGrvM8CvriAOCRcSnWXALI/nv0w=="}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:29:43.814414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-920eeafe-0c64-4258-971f-7255bbd85763 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Getting quotas for project 501da3536d6c41c5b8838bd643c33b22. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:29:43.818949 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.quota [None req-920eeafe-0c64-4258-971f-7255bbd85763 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Getting quotas for user ed482cfcdfe4460fb158ca5d8c92fc99 and project 501da3536d6c41c5b8838bd643c33b22. Resources: {'key_pairs'} {{(pid=117570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:29:43.841143 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-920eeafe-0c64-4258-971f-7255bbd85763 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.214379 Jun 03 16:29:43.842030 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 675/1375] 10.222.0.41 () {60 vars in 1158 bytes} [Fri Jun 3 16:29:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:30:11.641703 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=58 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:11.642444 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:11.647356 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-829661437", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1954646034", "security_groups": [{"name": "tempest-secgroup-smoke-1059018516"}], "networks": [{"uuid": "c42bf97a-89da-4838-8dba-c73b151d3074"}], "block_device_mapping_v2": [{"uuid": "29097cbf-175a-4617-9e8a-7cdb9c89b2da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:30:11.762782 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.network.neutron [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] validate_networks() for [('c42bf97a-89da-4838-8dba-c73b151d3074', None, None, None, None, None)] {{(pid=117571) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 16:30:12.233966 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Flavor limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 16:30:12.234392 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Image limits 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 16:30:12.234881 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Flavor pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 16:30:12.235327 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Image pref 0:0:0 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 16:30:12.235744 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.virt.hardware [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 16:30:12.245584 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:12.246047 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:12.246888 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:12.247369 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:12.266419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Getting quotas for project 501da3536d6c41c5b8838bd643c33b22. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 16:30:12.270419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.quota [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Getting quotas for user ed482cfcdfe4460fb158ca5d8c92fc99 and project 501da3536d6c41c5b8838bd643c33b22. Resources: {'ram', 'cores', 'instances'} {{(pid=117571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 16:30:12.328898 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Going to run 1 instances... {{(pid=117571) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 16:30:12.331065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29097cbf-175a-4617-9e8a-7cdb9c89b2da',volume_size=None,volume_type=None)] {{(pid=117571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 16:30:12.457657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-256a2e15-fa37-491b-a168-abe6021c5e92 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817401 Jun 03 16:30:12.458385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 701/1376] 10.222.0.41 () {60 vars in 1146 bytes} [Fri Jun 3 16:30:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 16:30:12.466712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=4 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:12.467459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:12.472080 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-24a7aee1-f6d9-4f5a-b6d2-7cbcb00aff8e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:12.472696 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-24a7aee1-f6d9-4f5a-b6d2-7cbcb00aff8e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:12.528154 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-24a7aee1-f6d9-4f5a-b6d2-7cbcb00aff8e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:12.535316 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-24a7aee1-f6d9-4f5a-b6d2-7cbcb00aff8e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1088 microversion: 2.1 time: 0.070934 Jun 03 16:30:12.536444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 676/1377] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:12 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:13.553474 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:13.554379 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:13.561282 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:13.561733 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:13.562535 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:13.563004 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:13.626250 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:13.634469 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-6de79596-df14-4251-9a66-234469f060a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1204 microversion: 2.1 time: 0.085534 Jun 03 16:30:13.635025 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 702/1378] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:13 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:14.651541 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:14.652811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:14.659487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:14.659941 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:14.661391 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:14.662021 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:14.769598 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-04cefa7c-cf17-4fc7-bc63-f6002000194a req-0aab0116-6085-49f1-8853-0fc0771fa3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:30:14.782102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-04cefa7c-cf17-4fc7-bc63-f6002000194a req-0aab0116-6085-49f1-8853-0fc0771fa3a5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:14.782568 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-04cefa7c-cf17-4fc7-bc63-f6002000194a req-0aab0116-6085-49f1-8853-0fc0771fa3a5 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:14.802887 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-04cefa7c-cf17-4fc7-bc63-f6002000194a req-0aab0116-6085-49f1-8853-0fc0771fa3a5 service nova] Creating event network-changed:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:30:14.808420 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-04cefa7c-cf17-4fc7-bc63-f6002000194a req-0aab0116-6085-49f1-8853-0fc0771fa3a5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042502 Jun 03 16:30:14.810448 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 703/1379] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:30:14.889545 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:14.898315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-842858e3-a1f7-4696-a535-3cb8da80ba80 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.250699 Jun 03 16:30:14.899081 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 677/1380] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:14 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:15.917438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:15.918145 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:15.924367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:15.924824 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:15.925594 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:15.926035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:16.058219 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:16.065687 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-034ff5f8-e0b1-42c8-83c0-2e526050dd9e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.152885 Jun 03 16:30:16.066286 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 704/1381] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:15 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:17.081874 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:17.082497 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:17.089030 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:17.089490 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:17.090305 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:17.090748 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:17.295725 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:17.303812 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8f8c6499-97af-4e7d-a512-43e01aacf19c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.225822 Jun 03 16:30:17.304462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 678/1382] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:17 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:18.320247 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:18.321015 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:18.327693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:18.328217 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:18.329120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:18.329557 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:18.457120 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:18.464589 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-b0afae10-d38a-4532-b9c6-b6b77a105910 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.148794 Jun 03 16:30:18.465152 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 705/1383] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:18 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:19.481160 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:19.481777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:19.488158 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:19.488610 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:19.489995 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:19.490437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:19.620327 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:19.627738 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-14e16a9e-f3b9-4dd6-a3ea-6baa9b55c492 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.150349 Jun 03 16:30:19.628300 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 679/1384] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:19 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:20.644051 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:20.644668 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:20.651046 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:20.651529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:20.652298 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:20.652736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:20.786295 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:20.793810 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-12cbe66e-4f05-4d17-8fde-e322dcb2d9e5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.153520 Jun 03 16:30:20.794365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 706/1385] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:20 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:21.809878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:21.810500 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:21.816928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:21.817870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:21.818664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:21.819104 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:21.973024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:21.981013 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-243aa985-9921-4aa2-aac2-539feededd57 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.175015 Jun 03 16:30:21.981611 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 680/1386] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:21 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:22.997701 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:22.998404 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:23.000955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=2 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:23.001790 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell0:SELECT=6 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:23.009430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:23.009884 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:23.010655 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:23.011090 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:23.148080 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:23.155876 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-381de8b5-6bcb-4fac-89a7-a891ff653e3c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.162170 Jun 03 16:30:23.156434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 707/1387] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:22 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:24.173538 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:24.174090 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:24.176256 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell0:SELECT=2 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:30:24.182716 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:24.183168 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:24.183970 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:24.184417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:24.559669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:24.567315 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6e3cb086-892a-4c5d-941c-366b9680f52a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.397723 Jun 03 16:30:24.567871 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 681/1388] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:24 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:25.584795 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:25.585328 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:25.591847 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:25.592301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:25.593068 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:25.593508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:25.719271 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:25.726659 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a9b1130b-dad4-454e-bbc6-faa60606a7e6 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.146602 Jun 03 16:30:25.727223 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 708/1389] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:25 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:26.743712 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:26.744344 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:26.750786 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:26.751238 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:26.752041 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:26.752485 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:26.884768 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:26.892392 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e6a40172-788d-4b22-9213-bda99e50efd2 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.153058 Jun 03 16:30:26.892962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 682/1390] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:26 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:27.909448 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:27.910056 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:27.916643 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:27.917089 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:27.917858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:27.918290 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:28.054565 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:28.062246 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8242cce0-8e18-43d8-b854-312e1e69f7a9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.156616 Jun 03 16:30:28.062826 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 709/1391] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:27 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:29.079462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:29.080082 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:29.086371 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:29.086849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:29.087660 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:29.088109 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:29.224825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:29.232864 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-a1c5c032-9829-4625-8b5d-81e7a8365c65 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.157484 Jun 03 16:30:29.233437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 683/1392] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:29 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:30.250055 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:30.251431 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:30.258579 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:30.259033 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:30.259850 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:30.260287 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:30.399516 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:30.407705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-fe7c4ed3-6751-420a-aeeb-67e9b1467189 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.161477 Jun 03 16:30:30.408278 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 710/1393] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:30 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:31.425075 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:31.425694 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:31.435142 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:31.435784 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:31.436467 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:31.437059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:31.595188 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:31.608053 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8907f22c-a248-477a-8a64-bef783b2658e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.186730 Jun 03 16:30:31.611405 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 684/1394] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:31 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:32.625582 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:32.626344 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:32.634221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:32.634681 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:32.635572 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:32.635975 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:32.785049 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:32.794208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-5a30a72f-0418-43be-84e6-e62ea7172dc7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.172646 Jun 03 16:30:32.794789 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 711/1395] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:32 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:33.810963 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:33.811626 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:33.818731 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:33.819426 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:33.820380 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:33.821038 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:33.967387 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:33.978771 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-047c2411-791f-440b-ab99-9cb30c84b731 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.171599 Jun 03 16:30:33.988277 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 685/1396] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:33 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:34.995601 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:34.996211 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:35.002272 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:35.002728 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:35.003537 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:35.003977 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:35.135457 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:35.142835 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c0dba844-caab-4a84-b9bc-1774c0160a5b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.151283 Jun 03 16:30:35.143419 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 712/1397] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:34 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:35.509825 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-9290aba8-0806-4d1e-8c58-5457d4575cb0 req-33f5dfe5-7297-4140-82bb-982b045ed597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "name": "network-vif-plugged", "status": "completed", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:30:35.518717 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-9290aba8-0806-4d1e-8c58-5457d4575cb0 req-33f5dfe5-7297-4140-82bb-982b045ed597 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:35.519212 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-9290aba8-0806-4d1e-8c58-5457d4575cb0 req-33f5dfe5-7297-4140-82bb-982b045ed597 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:35.537016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-9290aba8-0806-4d1e-8c58-5457d4575cb0 req-33f5dfe5-7297-4140-82bb-982b045ed597 service nova] Creating event network-vif-plugged:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:30:35.543487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-9290aba8-0806-4d1e-8c58-5457d4575cb0 req-33f5dfe5-7297-4140-82bb-982b045ed597 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 Jun 03 16:30:35.544085 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 686/1398] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 16:30:36.160545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:36.161202 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:36.167683 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:36.168134 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:36.168896 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:36.169331 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:36.316069 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:36.324301 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-0f16a107-e8ec-4311-929f-5d1bd42375e9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.167534 Jun 03 16:30:36.324864 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 713/1399] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:36 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:37.341524 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:37.342221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:37.351199 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:37.351669 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:37.352435 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:37.352868 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:37.485763 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:37.493301 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-120df95c-5970-4c49-b69d-d28db8146e1c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1260 microversion: 2.1 time: 0.155972 Jun 03 16:30:37.493854 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 687/1400] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:37 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:38.511109 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:38.511676 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:38.518251 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:38.518702 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:38.519513 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:38.519961 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:38.649862 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:38.657556 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-c4ab1069-acf0-4b57-9aa3-d7f90129f403 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1443 microversion: 2.1 time: 0.150330 Jun 03 16:30:38.658147 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 714/1401] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:38 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:38.673218 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:30:38.673835 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:30:38.680811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:38.681261 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:38.682024 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:38.682462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:38.809074 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:30:38.816504 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-2b0d7cc6-00d0-444e-92da-934c22772bee tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1443 microversion: 2.1 time: 0.147100 Jun 03 16:30:38.817065 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 688/1402] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:30:38 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:30:40.487099 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-412ea04f-6fe8-45f5-ba58-bcc82c8c0327 req-cbaec135-20ff-4031-a3fc-5b1c0e93db2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:30:40.496368 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-412ea04f-6fe8-45f5-ba58-bcc82c8c0327 req-cbaec135-20ff-4031-a3fc-5b1c0e93db2a service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:30:40.496825 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-412ea04f-6fe8-45f5-ba58-bcc82c8c0327 req-cbaec135-20ff-4031-a3fc-5b1c0e93db2a service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:30:40.507559 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-412ea04f-6fe8-45f5-ba58-bcc82c8c0327 req-cbaec135-20ff-4031-a3fc-5b1c0e93db2a service nova] Creating event network-changed:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:30:40.512708 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-412ea04f-6fe8-45f5-ba58-bcc82c8c0327 req-cbaec135-20ff-4031-a3fc-5b1c0e93db2a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029274 Jun 03 16:30:40.513596 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 715/1403] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:32:26.853234 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:32:26.853875 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:32:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:32:30.505464 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:32:30.505922 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:32:46.577558 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:32:46.578132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:32:54.634198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=28 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:54.634876 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=68 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:54.638925 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:32:54.639498 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:32:54.646710 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:54.647185 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:54.647942 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:54.648385 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:54.671069 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.objects.instance [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lazy-loading 'flavor' on Instance uuid 7854e572-b5f6-4574-8ea2-ab7b3db3202b {{(pid=117570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 16:32:54.739698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-cdd32ff4-938b-49e2-8495-cda66c8fb20d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "POST /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b/action" status: 202 len: 0 microversion: 2.1 time: 0.106977 Jun 03 16:32:54.740451 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 689/1404] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:32:54 2022] POST /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:32:54.746865 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e19685b-af4a-4b87-8b3b-a40be41ee14a] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 16:32:54.747517 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:54.748382 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=78 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:32:54.752981 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:32:54.753740 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:32:54.761430 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:54.761993 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:54.762775 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:54.763215 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:55.009693 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:32:55.017867 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-96b09d0e-9c5a-4ad7-9f63-b64006dbbe16 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.272818 Jun 03 16:32:55.018421 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 716/1405] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:32:54 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:32:56.036414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:32:56.037121 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:32:56.044100 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:56.044551 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:56.045312 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:56.045750 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:56.224958 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:32:56.232580 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-012e296f-d302-4520-9b42-a839f29f0427 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.200567 Jun 03 16:32:56.233077 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 690/1406] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:32:56 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:32:57.249367 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:32:57.249978 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:32:57.258486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:57.258936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:57.259736 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:57.260174 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:57.265615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e19685b-af4a-4b87-8b3b-a40be41ee14a] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38056. Jun 03 16:32:57.388547 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:32:57.396939 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-222206df-e2be-45cb-a84a-fe61f15073dc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.151460 Jun 03 16:32:57.397499 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 717/1407] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:32:57 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:32:58.413267 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:32:58.413885 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:32:58.420314 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:58.420760 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:58.421519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:58.421957 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:58.547879 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:32:58.555910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-22799ca9-8dad-4301-87c0-56b2847b5fd4 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.146597 Jun 03 16:32:58.556477 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 691/1408] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:32:58 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:32:59.572746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:32:59.573315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:32:59.579787 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:59.580242 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:59.581644 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:32:59.582102 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:32:59.713336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:32:59.720917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-674444ca-31a9-4589-9b09-a4e56d7f05e8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.152038 Jun 03 16:32:59.721471 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 718/1409] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:32:59 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:00.737839 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:00.738588 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:00.745231 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:00.745679 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:00.746436 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:00.746870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:00.889292 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:00.897848 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6ee043dd-6a73-4e68-aed5-b3734f255e1b tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.163938 Jun 03 16:33:00.898414 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 692/1410] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:00 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:01.915785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:01.916394 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:01.922836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:01.923277 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:01.924065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:01.924498 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:02.064926 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:02.071220 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-23f7e01f-28ca-4aff-bcf6-bd7bccc04a0d tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.159148 Jun 03 16:33:02.071837 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 719/1411] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:01 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:03.088196 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:03.088814 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:03.095227 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:03.095708 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:03.096470 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:03.096906 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:03.221653 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:03.229233 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7b4c39ac-aee8-4cdb-aac4-9bf6bbb8deda tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.144831 Jun 03 16:33:03.229792 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 693/1412] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:03 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:04.245959 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:04.246529 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:04.253071 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:04.253527 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:04.254318 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:04.254741 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:04.383921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:04.391386 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-8e0f1fc7-64d9-463a-8ec1-537f0b016a10 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.149305 Jun 03 16:33:04.391940 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 720/1413] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:04 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:05.409587 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:05.410237 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:05.416795 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:05.417240 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:05.417997 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:05.418428 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:05.546650 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:05.554765 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-199a04b8-a065-4e8a-a039-2c9fb376d5f8 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.149882 Jun 03 16:33:05.555342 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 694/1414] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:05 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:06.571836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:06.572388 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:06.578871 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:06.579333 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:06.580096 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:06.580528 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:06.708346 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:06.715895 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ac86cbbb-752a-4925-b0b1-3ddc6c78b3af tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.147994 Jun 03 16:33:06.716449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 721/1415] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:06 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:07.733317 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:07.733930 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:07.740388 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:07.740832 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:07.741585 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:07.742018 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:07.869462 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:07.876899 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6fd0705a-f833-456a-8a92-ceba324445cc tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.147438 Jun 03 16:33:07.877459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 695/1416] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:07 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:08.893811 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:08.894434 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:08.900906 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:08.901362 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:08.902132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:08.902573 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:09.032013 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:09.040116 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-ac67e936-b344-4779-bbd5-9712455be3e1 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.150109 Jun 03 16:33:09.040684 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 722/1417] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:08 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:10.057113 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:10.057726 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:10.064433 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:10.064971 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:10.065777 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:10.066221 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:10.270069 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:10.277735 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-8c874563-cd33-4d62-a72e-4209e0dcc16c tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.224563 Jun 03 16:33:10.278306 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 696/1418] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:10 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:11.294925 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:11.295563 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:11.302681 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:11.303132 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:11.303937 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:11.304380 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:11.442416 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:11.453590 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-e55bb486-d8f5-462b-9c1b-42651c12768f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.162504 Jun 03 16:33:11.454162 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 723/1419] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:11 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:12.469928 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:12.470549 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:12.477709 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:12.478164 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:12.478932 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:12.479409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:12.610459 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:12.617962 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-3b5b6c45-0732-41eb-ae31-10fdb4b77b82 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1569 microversion: 2.1 time: 0.151930 Jun 03 16:33:12.618533 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 697/1420] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:12 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:12.633867 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:33:12.634438 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:12.640921 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:12.641365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:12.642123 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:12.642554 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:12.732480 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-dfd1a01c-e4e9-4f5c-b1ee-aa0817219cb5 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "POST /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b/action" status: 202 len: 0 microversion: 2.1 time: 0.102151 Jun 03 16:33:12.733504 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 724/1421] 10.222.0.41 () {60 vars in 1277 bytes} [Fri Jun 3 16:33:12 2022] POST /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:33:12.744093 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:12.744704 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:12.750833 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:12.751287 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:12.752198 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:12.752651 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:12.921870 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:12.929308 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-e97d816e-1c48-4ec4-807b-044d2f983a8a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1517 microversion: 2.1 time: 0.189046 Jun 03 16:33:12.930009 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 698/1422] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:12 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:13.947775 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:13.948385 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:13.954731 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:13.955195 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:13.956065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:13.956518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:14.090437 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:14.098038 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3d3f9297-7546-42f2-8139-0521be5637f9 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.154881 Jun 03 16:33:14.098606 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 725/1423] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:13 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:14.422591 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [req-fb5e933d-e03d-47c0-9fc3-06d2a6c49c2d req-0c1d92f9-1ea6-47b8-8aea-e09785face4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "name": "network-vif-unplugged", "status": "completed", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:33:14.431811 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-fb5e933d-e03d-47c0-9fc3-06d2a6c49c2d req-0c1d92f9-1ea6-47b8-8aea-e09785face4e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:14.432276 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [req-fb5e933d-e03d-47c0-9fc3-06d2a6c49c2d req-0c1d92f9-1ea6-47b8-8aea-e09785face4e service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:14.445769 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.compute.server_external_events [req-fb5e933d-e03d-47c0-9fc3-06d2a6c49c2d req-0c1d92f9-1ea6-47b8-8aea-e09785face4e service nova] Creating event network-vif-unplugged:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:33:14.450678 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [req-fb5e933d-e03d-47c0-9fc3-06d2a6c49c2d req-0c1d92f9-1ea6-47b8-8aea-e09785face4e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105888 Jun 03 16:33:14.451519 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 699/1424] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:33:15.115442 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:15.116076 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:15.122221 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:15.122671 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:15.123477 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:15.123917 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:15.254829 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:15.262275 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-99a6fe8c-ad8e-4b47-a6fe-47b684f5ec6e tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.150677 Jun 03 16:33:15.262836 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 726/1425] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:15 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:16.280930 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:16.281901 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:16.288698 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:16.289141 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:16.289893 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:16.290330 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:16.417419 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:16.424852 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-48056feb-836d-4fb9-a0d3-def307804409 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.148799 Jun 03 16:33:16.425410 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 700/1426] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:16 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:17.442107 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:17.442718 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:17.449294 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:17.449743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:17.450505 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:17.450938 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:17.585065 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:17.592526 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-682ecab6-8fbc-402b-a1b3-c00008f36c97 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.154813 Jun 03 16:33:17.593088 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 727/1427] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:17 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:18.609417 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:18.609965 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:18.616409 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:18.616860 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:18.617623 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:18.618059 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:18.747016 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:18.755005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-45511405-017f-4c19-8370-453b5b97c630 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.149599 Jun 03 16:33:18.755604 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 701/1428] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:18 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:19.772435 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:19.773041 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:19.779508 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:19.779955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:19.780784 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:19.781218 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:19.908518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:19.915974 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-d1612b88-b828-4e99-86b9-0472de16e87f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.147953 Jun 03 16:33:19.916545 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 728/1429] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:19 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:20.933355 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:20.933991 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:20.940427 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:20.941406 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:20.942170 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:20.942606 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:21.068878 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:21.076382 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-179cb5ed-570e-4346-9109-dbf27cb716a7 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.146952 Jun 03 16:33:21.076952 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 702/1430] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:20 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:22.094167 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:22.094777 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:22.101289 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:22.101743 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:22.102517 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:22.102955 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:22.234209 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:22.241838 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-68361d70-a198-44d6-8a96-0054cbeabf07 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1575 microversion: 2.1 time: 0.151524 Jun 03 16:33:22.242400 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 729/1431] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:22 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:23.259032 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:33:23.259685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:33:23.266203 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:23.266654 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:23.267447 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:23.267888 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:23.401975 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:33:23.409833 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-6529a1f2-a2bd-4880-b9a0-ba95ce290e7f tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1562 microversion: 2.1 time: 0.154674 Jun 03 16:33:23.410398 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 703/1432] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:33:23 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:33:24.434531 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-ef90072d-a8b6-4549-bbe8-df44803ce961 req-14d5c8c5-57b6-44d3-9641-dcc536c72f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "name": "network-vif-plugged", "status": "completed", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:33:24.444157 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-ef90072d-a8b6-4549-bbe8-df44803ce961 req-14d5c8c5-57b6-44d3-9641-dcc536c72f18 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:33:24.444615 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-ef90072d-a8b6-4549-bbe8-df44803ce961 req-14d5c8c5-57b6-44d3-9641-dcc536c72f18 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:33:24.455544 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-ef90072d-a8b6-4549-bbe8-df44803ce961 req-14d5c8c5-57b6-44d3-9641-dcc536c72f18 service nova] Creating event network-vif-plugged:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:33:24.464274 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-ef90072d-a8b6-4549-bbe8-df44803ce961 req-14d5c8c5-57b6-44d3-9641-dcc536c72f18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033399 Jun 03 16:33:24.465100 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 730/1433] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:34:53.121849 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_api:SELECT=30 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:53.122693 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG dbcounter [-] [117570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:53.125785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_api:SELECT=32 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:53.126487 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:34:53.126775 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG dbcounter [-] [117571] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 16:34:53.126985 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:34:53.146946 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:53.147444 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:53.148228 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:53.148664 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:53.185658 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Going to try to terminate instance {{(pid=117570) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 16:34:53.201018 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-fc4a016b-d42b-42b8-9b65-459cbbd7b5d7 req-9761f519-b16a-44a9-8d2d-c97afd501809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:34:53.209785 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-fc4a016b-d42b-42b8-9b65-459cbbd7b5d7 req-9761f519-b16a-44a9-8d2d-c97afd501809 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:53.210238 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-fc4a016b-d42b-42b8-9b65-459cbbd7b5d7 req-9761f519-b16a-44a9-8d2d-c97afd501809 service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:53.222187 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-fc4a016b-d42b-42b8-9b65-459cbbd7b5d7 req-9761f519-b16a-44a9-8d2d-c97afd501809 service nova] Creating event network-changed:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:34:53.228518 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-fc4a016b-d42b-42b8-9b65-459cbbd7b5d7 req-9761f519-b16a-44a9-8d2d-c97afd501809 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105125 Jun 03 16:34:53.229746 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 731/1434] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:34:53.280764 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-7192dc70-ca0d-433f-b390-26390135d924 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 204 len: 0 microversion: 2.1 time: 0.160781 Jun 03 16:34:53.281437 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 704/1435] 10.222.0.41 () {58 vars in 1238 bytes} [Fri Jun 3 16:34:53 2022] DELETE /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 16:34:53.293760 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:34:53.294503 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:34:53.301486 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:53.301944 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:53.302858 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:53.303312 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:53.433900 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.policy [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117571) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:34:53.441756 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-a270b1cc-99c4-4213-9f30-109eb741d5bf tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.154678 Jun 03 16:34:53.442336 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 732/1436] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:34:53 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:34:54.460790 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:34:54.461508 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:34:54.468229 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:54.468685 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:54.469472 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:54.469921 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:54.624779 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:34:54.632304 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-5d231268-4950-4161-a4a5-052078969b54 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1568 microversion: 2.1 time: 0.175857 Jun 03 16:34:54.632872 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 705/1437] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:34:54 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:34:55.382737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [req-b1d9ec8d-ef70-4bc2-9469-5d3cf763cfce req-0609bd11-0333-40de-8123-0270ef939ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7854e572-b5f6-4574-8ea2-ab7b3db3202b", "name": "network-vif-deleted", "tag": "919f5cbc-bd62-40ac-b638-d6a7f6871b60"}]} {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 16:34:55.393139 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-b1d9ec8d-ef70-4bc2-9469-5d3cf763cfce req-0609bd11-0333-40de-8123-0270ef939ebe service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:55.393691 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [req-b1d9ec8d-ef70-4bc2-9469-5d3cf763cfce req-0609bd11-0333-40de-8123-0270ef939ebe service nova] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:55.405302 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.compute.server_external_events [req-b1d9ec8d-ef70-4bc2-9469-5d3cf763cfce req-0609bd11-0333-40de-8123-0270ef939ebe service nova] Creating event network-vif-deleted:919f5cbc-bd62-40ac-b638-d6a7f6871b60 for instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b on hv-cinder-83699 Jun 03 16:34:55.411118 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [req-b1d9ec8d-ef70-4bc2-9469-5d3cf763cfce req-0609bd11-0333-40de-8123-0270ef939ebe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032058 Jun 03 16:34:55.411705 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 733/1438] 10.222.0.41 () {64 vars in 1317 bytes} [Fri Jun 3 16:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 16:34:55.649976 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:34:55.650702 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.compute.api [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117570) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:34:55.658991 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:55.659339 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:55.660125 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:55.660561 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG oslo_concurrency.lockutils [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:55.894453 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.policy [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed482cfcdfe4460fb158ca5d8c92fc99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501da3536d6c41c5b8838bd643c33b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117570) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 16:34:55.901899 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-c9fce92b-74e6-4b74-8d7a-a9adeaefbb38 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 200 len: 1219 microversion: 2.1 time: 0.255859 Jun 03 16:34:55.902993 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 706/1439] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:34:55 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 1219 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 16:34:56.920417 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '>' {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:34:56.921138 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.compute.api [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [instance: 7854e572-b5f6-4574-8ea2-ab7b3db3202b] Fetching instance by UUID {{(pid=117571) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 16:34:56.927737 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:56.928180 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:56.928936 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 16:34:56.929365 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG oslo_concurrency.lockutils [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Lock "3aa4319c-5fbd-4b59-928b-816489450cee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 16:34:56.942657 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.wsgi [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] HTTP exception thrown: Instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b could not be found. Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Request method failure captured: Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: request: GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b HTTP/1.1 Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept: application/json Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Accept-Encoding: identity Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Connection: close Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Length: 0 Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Content-Type: application/json Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Host: 10.222.0.41 Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Openstack-System-Scope: None Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: User-Agent: python-urllib3/1.26.9 Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Auth-Token: gAAAAABimjbyZbi4h2mKYvCPpMQYu5tJ6PeFzexguqZqfSjHQUqYEQBxk33fnxvUEJfHUvYUoX1PD8XGkyWn0pHgz82NF524APo3ewFJp3dkCGK-2iopQimdqsCfMm-qjl9ksGsxB7bhCd5MuFIvVMAAQRubUg-HvX_2vKkezjUczmBHqAfA2Co Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Id: None Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Domain-Name: None Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Identity-Status: Confirmed Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Is-Admin-Project: True Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Id: default Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Domain-Name: Default Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Id: 501da3536d6c41c5b8838bd643c33b22 Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Project-Name: tempest-TestShelveInstance-671577073 Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Role: member,reader Jun 03 16:34:56.944253 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Roles: member,reader Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/501da3536d6c41c5b8838bd643c33b22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/501da3536d6c41c5b8838bd643c33b22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/501da3536d6c41c5b8838bd643c33b22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_501da3536d6c41c5b8838bd643c33b22"}]}] Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant: tempest-TestShelveInstance-671577073 Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Id: 501da3536d6c41c5b8838bd643c33b22 Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-Tenant-Name: tempest-TestShelveInstance-671577073 Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User: tempest-TestShelveInstance-671577073-project Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Id: default Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Domain-Name: Default Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Id: ed482cfcdfe4460fb158ca5d8c92fc99 Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: X-User-Name: tempest-TestShelveInstance-671577073-project Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: method: > Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: exception: Instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b could not be found. Jun 03 16:34:56.946035 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: action_args: {'id': '7854e572-b5f6-4574-8ea2-ab7b3db3202b'} Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: {{(pid=117571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b could not be found. Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 16:34:56.947077 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b could not be found. Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b could not be found. Jun 03 16:34:56.948875 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: ERROR nova.api.openstack.wsgi Jun 03 16:34:56.950498 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: DEBUG nova.api.openstack.wsgi [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Returning 404 to user: Instance 7854e572-b5f6-4574-8ea2-ab7b3db3202b could not be found. {{(pid=117571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 16:34:56.950498 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO nova.api.openstack.requestlog [None req-3703471b-090f-4daf-86a3-ca938f8a2e78 tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b" status: 404 len: 111 microversion: 2.1 time: 0.030051 Jun 03 16:34:56.950498 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: [pid: 117571|app: 0|req: 734/1440] 10.222.0.41 () {58 vars in 1235 bytes} [Fri Jun 3 16:34:56 2022] GET /compute/v2.1/servers/7854e572-b5f6-4574-8ea2-ab7b3db3202b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 16:34:57.102131 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: DEBUG nova.api.openstack.wsgi [None req-0534f9c0-dded-48e2-9092-fe8aeab5ff9a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] Calling method '.version_select at 0x7fb5c5e3c040>' {{(pid=117570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 16:34:57.105333 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0534f9c0-dded-48e2-9092-fe8aeab5ff9a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [ac749731-4dbb-4daf-8b15-6928ef6b00a3] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 16:34:58.112844 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [None req-0534f9c0-dded-48e2-9092-fe8aeab5ff9a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] [ac749731-4dbb-4daf-8b15-6928ef6b00a3] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 38182. Jun 03 16:34:58.131005 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO nova.api.openstack.requestlog [None req-0534f9c0-dded-48e2-9092-fe8aeab5ff9a tempest-TestShelveInstance-671577073 tempest-TestShelveInstance-671577073-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1954646034" status: 202 len: 0 microversion: 2.1 time: 1.032731 Jun 03 16:34:58.131603 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: [pid: 117570|app: 0|req: 707/1441] 10.222.0.41 () {58 vars in 1253 bytes} [Fri Jun 3 16:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1954646034 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 16:35:46.862496 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:35:46.863235 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:35:50.513784 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:35:50.514315 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:36:06.585843 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:36:06.586484 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:37:48.192919 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:37:48.193418 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:37:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:38:11.693449 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:38:11.694045 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:38:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:39:06.870289 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:39:06.870910 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:39:10.521408 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:39:10.521864 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:39:26.593641 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:39:26.594208 dv-cinder-836996-28-iscsi devstack@n-api.service[117571]: Fri Jun 3 16:39:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 16:40:12.460729 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 16:40:12.461353 dv-cinder-836996-28-iscsi devstack@n-api.service[117570]: Fri Jun 3 16:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!